Attention mechanisms in transformers: a new formula with mathematical foundations and enhanced interpretability
| dc.contributor.advisor | Vieiro Yanes, Arturo | |
| dc.contributor.author | Conti, Eddie | |
| dc.date.accessioned | 2024-09-10T09:30:25Z | |
| dc.date.available | 2024-09-10T09:30:25Z | |
| dc.date.issued | 2024-07-09 | |
| dc.description | Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Curs: 2023-2024. Tutor: Arturo Vieiro Yanes i Oriol Pujol Vila | ca |
| dc.description.abstract | [en] Large Language Models (LLMs) are AI systems capable of understanding and generating human language by processing vast amounts of text data. In recent years, specifically from 2017, the use of LLMs significantly increased thanks to the introduction of the Transformer architecture. | ca |
| dc.format.extent | 35 p. | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | https://hdl.handle.net/2445/215077 | |
| dc.language.iso | eng | ca |
| dc.rights | cc-by-nc-nd (c) Eddie Conti, 2023 | |
| dc.rights | codi: GPL (c) Eddie Conti, 2023 | |
| dc.rights.accessRights | info:eu-repo/semantics/openAccess | ca |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/3.0/es/ | * |
| dc.rights.uri | http://www.gnu.org/licenses/gpl-3.0.ca.html | * |
| dc.source | Màster Oficial - Fonaments de la Ciència de Dades | |
| dc.subject.classification | Tractament del llenguatge natural (Informàtica) | |
| dc.subject.classification | Processament de dades | |
| dc.subject.classification | Xarxes neuronals (Informàtica) | |
| dc.subject.classification | Treballs de fi de màster | |
| dc.subject.other | Natural language processing (Computer science) | |
| dc.subject.other | Data processing | |
| dc.subject.other | Neural networks (Computer science) | |
| dc.subject.other | Master's thesis | |
| dc.title | Attention mechanisms in transformers: a new formula with mathematical foundations and enhanced interpretability | ca |
| dc.type | info:eu-repo/semantics/masterThesis | ca |
Fitxers
Paquet original
1 - 2 de 2
Carregant...
- Nom:
- tfm_conti_eddie.pdf
- Mida:
- 1.38 MB
- Format:
- Adobe Portable Document Format
- Descripció:
- Memòria
Carregant...
- Nom:
- Master-Thesis-UB-main.zip
- Mida:
- 796.03 KB
- Format:
- ZIP file
- Descripció:
- Codi font