Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models
| dc.contributor.advisor | Häyrinen, Noora | |
| dc.contributor.advisor | Modamio Charles, Pilar | |
| dc.contributor.advisor | Puertas i Prats, Eloi | |
| dc.contributor.author | Hernández Castilla, Ana Valentina | |
| dc.date.accessioned | 2026-10-23T12:17:47Z | |
| dc.date.available | 2026-10-23T12:17:47Z | |
| dc.date.issued | 2026-06-28 | |
| dc.description | Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Noora Jahanna Häyrinen, María Pilar Modamio i Eloi Puertas | |
| dc.description.abstract | Informed Consent Forms (ICF) and Patient Information Sheets (PIS) are central to clinical research: they guarantee that participants enter a trial having received a complete and intelligible description of its purpose, procedures, risks and rights. Their regulatory review, however, remains an almost entirely manual task: a reviewer must verify, item by item, that dozens of required elements are present in a document that often exceeds twenty pages, and must do so for every protocol amendment, a formal modification to the trial design after approval that requires a full re-review of the updated documents. This thesis presents a modular pipeline, which is a sequence of independent, replaceable processing stages communicating through file-based interfaces, that automates this review using locally hosted Large Language Models, so that no document ever leaves the user’s machine. The system, designed to operate on documents in either Spanish or English, extracts structured content from PDF documents (including scanned, vector-encoded and partially redacted pages), heuristically separates the PIS and ICF sections, evaluates each document against a 62-item regulatory checklist (49 PIS items + 13 ICF items) using a local LLM (Qwen2.5-14B served through Ollama), and produces a readability and clarity analysis for the patient-facing language. Results are delivered as multi-sheet Excel, Word and PDF reports. A separate validation module compares the system’s output against a manual expert evaluation of twenty documents, computing Cohen’s Kappa and per-item agreement metrics. The pipeline was tested on a corpus of 41 Spanish-language clinical documents drawn from ten therapeutic areas. Three additional experiments compared model sizes (7B vs 14B), assessed module independence, and tested a prompt modification. The work demonstrates that local LLMs can deliver a defensible, reproducible and confidentiality-preserving compliance assistant for a domain where commercial cloud APIs are not an option. The full source code is available at https://github.com/AnaVHdez/thesis_Final. | |
| dc.format.extent | 37 p. | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | https://hdl.handle.net/2445/232299 | |
| dc.language.iso | eng | |
| dc.rights | cc-by-nc-nd (c) Hernández Castilla, Ana Valentina, 2026 | |
| dc.rights.accessRights | info:eu-repo/semantics/openAccess | |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/3.0/es/ | |
| dc.subject.classification | Consentiment informat (Dret mèdic) | |
| dc.subject.classification | Assaigs clínics | |
| dc.subject.classification | Aprenentatge automàtic | |
| dc.subject.classification | Treballs de fi de màster | |
| dc.subject.other | Informed consent (Medical law) | |
| dc.subject.other | Clinical trials | |
| dc.subject.other | Machine learning | |
| dc.subject.other | Master's thesis | |
| dc.title | Automated Regulatory Compliance and Readability Assessment of Clinical Informed Consent Documents Using Local Large Language Models | |
| dc.type | info:eu-repo/semantics/masterThesis |
Fitxers
Paquet original
1 - 1 de 1
Carregant...
- Nom:
- TFM_Hernandez_Castilla_Ana_Valentina.pdf
- Mida:
- 620.32 KB
- Format:
- Adobe Portable Document Format