Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models

dc.contributor.advisorHäyrinen, Noora
dc.contributor.advisorModamio Charles, Pilar
dc.contributor.advisorPuertas i Prats, Eloi
dc.contributor.authorHernández Castilla, Ana Valentina
dc.date.accessioned2026-10-23T12:17:47Z
dc.date.available2026-10-23T12:17:47Z
dc.date.issued2026-06-28
dc.descriptionTreballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Noora Jahanna Häyrinen, María Pilar Modamio i Eloi Puertas
dc.description.abstractInformed Consent Forms (ICF) and Patient Information Sheets (PIS) are central to clinical research: they guarantee that participants enter a trial having received a complete and intelligible description of its purpose, procedures, risks and rights. Their regulatory review, however, remains an almost entirely manual task: a reviewer must verify, item by item, that dozens of required elements are present in a document that often exceeds twenty pages, and must do so for every protocol amendment, a formal modification to the trial design after approval that requires a full re-review of the updated documents. This thesis presents a modular pipeline, which is a sequence of independent, replaceable processing stages communicating through file-based interfaces, that automates this review using locally hosted Large Language Models, so that no document ever leaves the user’s machine. The system, designed to operate on documents in either Spanish or English, extracts structured content from PDF documents (including scanned, vector-encoded and partially redacted pages), heuristically separates the PIS and ICF sections, evaluates each document against a 62-item regulatory checklist (49 PIS items + 13 ICF items) using a local LLM (Qwen2.5-14B served through Ollama), and produces a readability and clarity analysis for the patient-facing language. Results are delivered as multi-sheet Excel, Word and PDF reports. A separate validation module compares the system’s output against a manual expert evaluation of twenty documents, computing Cohen’s Kappa and per-item agreement metrics. The pipeline was tested on a corpus of 41 Spanish-language clinical documents drawn from ten therapeutic areas. Three additional experiments compared model sizes (7B vs 14B), assessed module independence, and tested a prompt modification. The work demonstrates that local LLMs can deliver a defensible, reproducible and confidentiality-preserving compliance assistant for a domain where commercial cloud APIs are not an option. The full source code is available at https://github.com/AnaVHdez/thesis_Final.
dc.format.extent37 p.
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/2445/232299
dc.language.isoeng
dc.rightscc-by-nc-nd (c) Hernández Castilla, Ana Valentina, 2026
dc.rights.accessRightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.subject.classificationConsentiment informat (Dret mèdic)
dc.subject.classificationAssaigs clínics
dc.subject.classificationAprenentatge automàtic
dc.subject.classificationTreballs de fi de màster
dc.subject.otherInformed consent (Medical law)
dc.subject.otherClinical trials
dc.subject.otherMachine learning
dc.subject.otherMaster's thesis
dc.titleAutomated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models
dc.typeinfo:eu-repo/semantics/masterThesis

Fitxers

Paquet original

Mostrant 1 - 1 de 1
Carregant...
Miniatura
Nom:
TFM_Hernandez_Castilla_Ana_Valentina.pdf
Mida:
620.32 KB
Format:
Adobe Portable Document Format