Tipus de document
Treball de fi de màsterData de publicació
Llicència de publicació
Si us plau utilitzeu sempre aquest identificador per citar o enllaçar aquest document: https://hdl.handle.net/2445/232299
Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models
Títol de la revista
Director/Tutor
Contribució addicional
ISSN de la revista
Títol del volum
Resum
Informed Consent Forms (ICF) and Patient Information Sheets (PIS) are central to clinical research: they guarantee that participants enter a trial having received a complete and intelligible description of its purpose, procedures, risks and rights. Their regulatory review, however, remains an almost entirely manual task: a reviewer must verify, item by item, that dozens of required elements are present in a document that often exceeds twenty pages, and must do so for every protocol amendment, a formal modification to the trial design after approval that requires a full re-review of the updated documents. This thesis presents a modular pipeline, which is a sequence of independent, replaceable processing stages communicating through file-based interfaces, that automates this review using locally hosted Large Language Models, so that no document ever leaves the user’s machine. The system, designed to operate on documents in either Spanish or English, extracts structured content from PDF documents (including scanned, vector-encoded and partially redacted pages), heuristically separates the PIS and ICF sections, evaluates each document against a 62-item regulatory checklist (49 PIS items + 13 ICF items) using a local LLM (Qwen2.5-14B served through Ollama), and produces a readability and clarity analysis for the patient-facing language. Results are delivered as multi-sheet Excel, Word and PDF reports. A separate validation module compares the system’s output against a manual expert evaluation of twenty documents, computing Cohen’s Kappa and per-item agreement metrics. The pipeline was tested on a corpus of 41 Spanish-language clinical documents drawn from ten therapeutic areas. Three additional experiments compared model sizes (7B vs 14B), assessed module independence, and tested a prompt modification. The work demonstrates that local LLMs can deliver a defensible, reproducible and confidentiality-preserving compliance assistant for a domain where commercial cloud APIs are not an option. The full source code is available at https://github.com/AnaVHdez/thesis_Final.
Descripció
Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Noora Jahanna Häyrinen, María Pilar Modamio i Eloi Puertas
Recurs relacionat
Matèries (anglès)
Citació
Citació
HERNÁNDEZ CASTILLA, Ana Valentina. Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models. [consulted: 17 of November of 2026]. Available at: https://hdl.handle.net/2445/232299