Please use this identifier to cite or link to this item:
Title: Touch’n’learn; una aplicación multisensorial gamificada para el estudio del aprendizaje del inglés
Author: Rodríguez Campoy, Alejandro
Director/Tutor: Puig Puig, Anna
Rodríguez Santiago, Inmaculada
Xarxes neuronals (Informàtica)
Keywords: Ensenyament de llengües
Treballs de fi de grau
Aprenentatge sensorial
Language teaching
Bachelor's thesis
English language
Perceptual learning
Neural networks (Computer science)
Issue Date: 19-Jan-2020
Abstract: [en] In the present work, the gamified application Touch ’n’ Learn is analysed, designed and developed, which allows the necessary experiment to be carried out to confirm or refute the following hypothesis: “The learning of English in children between 5 and 6 years old, and in particular the distinction of similar phonemes, improves when tactile stimuli are involved, compared to when the stimuli are only auditive or visual”. This experiment is the object of the project ’Tactile learning of the sounds of a foreign language’ (Explora Ciencia/Tecnología del Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia). The construction of Touch ’n’ Learn starts from the analysis of the requirements set out by the researchers of the Explora project. The main requirement of the application is that the experiment should be carried out in a gamified environment, motivating and maintaining the attention of the subjects. Likewise, the information related to the development of the experiment must be kept updated in a database, so a 3-tier architecture is designed: client, server and framework. In order for the user to be able to track the speaker’s lips, a tool for detecting lip keypoints (OpenPose) is required. On the other hand, a phoneme recognizer (Pocketsphinx) is required to evaluate the pronunciation of children. Both utilities require a previous study of their mathematical foundations (Convolutional Neural Networks and Hidden Markov Models). Finally, a pilot test is carried out to gather the first impressions of the users.
Note: Treballs Finals de Grau de Matemàtiques, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2020, Director: Anna Puig Puig i Inmaculada Rodríguez Santiago
Appears in Collections:Treballs Finals de Grau (TFG) - Enginyeria Informàtica
Programari - Treballs de l'alumnat
Treballs Finals de Grau (TFG) - Matemàtiques

Files in This Item:
File Description SizeFormat 
166319.pdfMemòria26.48 MBAdobe PDFView/Open
Touch&Learn.apkAplicació121.67 MBUnknownView/Open
codi.zipCofdi font495.96 MBzipView/Open

This item is licensed under a Creative Commons License Creative Commons