Attention mechanisms in transformers: a new formula with mathematical foundations and enhanced interpretability

dc.contributor.advisorVieiro Yanes, Arturo
dc.contributor.authorConti, Eddie
dc.date.accessioned2024-09-10T09:30:25Z
dc.date.available2024-09-10T09:30:25Z
dc.date.issued2024-07-09
dc.descriptionTreballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Curs: 2023-2024. Tutor: Arturo Vieiro Yanes i Oriol Pujol Vilaca
dc.description.abstract[en] Large Language Models (LLMs) are AI systems capable of understanding and generating human language by processing vast amounts of text data. In recent years, specifically from 2017, the use of LLMs significantly increased thanks to the introduction of the Transformer architecture.ca
dc.format.extent35 p.
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/2445/215077
dc.language.isoengca
dc.rightscc-by-nc-nd (c) Eddie Conti, 2023
dc.rightscodi: GPL (c) Eddie Conti, 2023
dc.rights.accessRightsinfo:eu-repo/semantics/openAccessca
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/*
dc.rights.urihttp://www.gnu.org/licenses/gpl-3.0.ca.html*
dc.sourceMàster Oficial - Fonaments de la Ciència de Dades
dc.subject.classificationTractament del llenguatge natural (Informàtica)
dc.subject.classificationProcessament de dades
dc.subject.classificationXarxes neuronals (Informàtica)
dc.subject.classificationTreballs de fi de màster
dc.subject.otherNatural language processing (Computer science)
dc.subject.otherData processing
dc.subject.otherNeural networks (Computer science)
dc.subject.otherMaster's thesis
dc.titleAttention mechanisms in transformers: a new formula with mathematical foundations and enhanced interpretabilityca
dc.typeinfo:eu-repo/semantics/masterThesisca

Fitxers

Paquet original

Mostrant 1 - 2 de 2
Carregant...
Miniatura
Nom:
tfm_conti_eddie.pdf
Mida:
1.38 MB
Format:
Adobe Portable Document Format
Descripció:
Memòria
Carregant...
Miniatura
Nom:
Master-Thesis-UB-main.zip
Mida:
796.03 KB
Format:
ZIP file
Descripció:
Codi font