Bolaños, MarcRadeva, PetiaPeracaula Prat, Joan2021-02-082021-02-082020-09-13https://hdl.handle.net/2445/173728Treballs Finals de Grau d'Enginyeria Informàtica, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2020, Director: Marc Bolaños i Petia Radeva[en] Food recognition, object detection and classification applied to the food domain, is the main topic of this work. We have studied the problem of recognising food instances in tray images of self-service restaurants and have proposed a novel multimodal deep learning approach. From images and daily menus, the model presented uses two state of the art models in object detection and classification and a multimodal neural network to make significantly refined predictions compared to the baseline object detection model, achieving a class weighted average F1-score of 0.862. An ensemble model built from the proposed and the baseline models, also presented in this work, improves the results achieving a class weighted average F1-score of 0.877.81 p.application/pdfengmemòria: cc-nc-nd (c) Joan Peracaula Prat, 2020codi: GPL (c) Joan Peracaula Prat, 2019http://creativecommons.org/licenses/by-nc-nd/3.0/es/http://www.gnu.org/licenses/gpl-3.0.ca.htmlXarxes neuronals (Informàtica)Aprenentatge automàticProgramariTreballs de fi de grauProcessament digital d'imatgesVisió per ordinadorAlimentsNeural networks (Computer science)Machine learningComputer softwareDigital image processingComputer visionBachelor's thesesFoodinfo:eu-repo/semantics/bachelorThesisinfo:eu-repo/semantics/openAccess