Tipus de document

Treball de fi de màster

Data de publicació

Llicència de publicació

cc-by-nc-nd (c) Hernández Castilla, Ana Valentina, 2026
Si us plau utilitzeu sempre aquest identificador per citar o enllaçar aquest document: https://hdl.handle.net/2445/232299

Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models

Títol de la revista

Contribució addicional

ISSN de la revista

Títol del volum

Resum

Informed Consent Forms (ICF) and Patient Information Sheets (PIS) are central to clinical research: they guarantee that participants enter a trial having received a complete and intelligible description of its purpose, procedures, risks and rights. Their regulatory review, however, remains an almost entirely manual task: a reviewer must verify, item by item, that dozens of required elements are present in a document that often exceeds twenty pages, and must do so for every protocol amendment, a formal modification to the trial design after approval that requires a full re-review of the updated documents. This thesis presents a modular pipeline, which is a sequence of independent, replaceable processing stages communicating through file-based interfaces, that automates this review using locally hosted Large Language Models, so that no document ever leaves the user’s machine. The system, designed to operate on documents in either Spanish or English, extracts structured content from PDF documents (including scanned, vector-encoded and partially redacted pages), heuristically separates the PIS and ICF sections, evaluates each document against a 62-item regulatory checklist (49 PIS items + 13 ICF items) using a local LLM (Qwen2.5-14B served through Ollama), and produces a readability and clarity analysis for the patient-facing language. Results are delivered as multi-sheet Excel, Word and PDF reports. A separate validation module compares the system’s output against a manual expert evaluation of twenty documents, computing Cohen’s Kappa and per-item agreement metrics. The pipeline was tested on a corpus of 41 Spanish-language clinical documents drawn from ten therapeutic areas. Three additional experiments compared model sizes (7B vs 14B), assessed module independence, and tested a prompt modification. The work demonstrates that local LLMs can deliver a defensible, reproducible and confidentiality-preserving compliance assistant for a domain where commercial cloud APIs are not an option. The full source code is available at https://github.com/AnaVHdez/thesis_Final.

Descripció

Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Noora Jahanna Häyrinen, María Pilar Modamio i Eloi Puertas

Recurs relacionat

Citació

Citació

HERNÁNDEZ CASTILLA, Ana Valentina. Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models. [consulted: 17 of November of 2026]. Available at: https://hdl.handle.net/2445/232299

Exportar metadades

JSON - METS

Compartir registre