Please use this identifier to cite or link to this item:
http://hdl.handle.net/2445/215400
Title: | Evaluating Large Language Models as computer programming teaching assistants |
Author: | Pol Pujadas, Maria Magdalena |
Director/Tutor: | Ortiz Martínez, Daniel Puertas i Prats, Eloi |
Keywords: | Tractament del llenguatge natural (Informàtica) Sistemes informàtics interactius Programació (Ordinadors) Treballs de fi de màster Natural language processing (Computer science) Interactive computer systems Computer programming Master's thesis |
Issue Date: | 30-Jun-2024 |
Abstract: | [en] The principal aim of this project is to conduct an analysis of how different Large Language Models (LLMs) operate in diverse context and situations in the field of education. In particular, we aim to assess the suitability of LLMs for specific tasks within the domain of algorithmic subjects within computer science studies. The tasks under analysis are designed to assist both students and teachers. With regard to students, we will assess the capacity of the models to implement a specified code. When it comes to teachers, we will evaluate the models’ abilities to identify the target of the introduced code and potential errors introduced by students in their codes, enabling students to become more self-taught and seek assistance from teachers when necessary. To evaluate these tasks, we have considered eight models. Two closed-source models were evaluated: GPT-3.5 and GPT-4. Five open-source models were also considered: Llama2, Codellama instruct, Llama3, Platypus2, Deepseek Coder and Qwen-1.5. |
Note: | Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Curs: 2023-2024. Tutor: Daniel Ortiz Martínez i Eloi Puertas i Prats |
URI: | http://hdl.handle.net/2445/215400 |
Appears in Collections: | Màster Oficial - Fonaments de la Ciència de Dades Programari - Treballs de l'alumnat |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Thesis-MSc-FPDS-main.zip | Codi font | 4.59 MB | zip | View/Open |
tfm_pol_pujadas_maria_magdalena.pdf | Memòria | 449.75 kB | Adobe PDF | View/Open |
This item is licensed under a Creative Commons License