Please use this identifier to cite or link to this item:
http://hdl.handle.net/2445/132906
Title: | Where am I eating? Image-based food menu recognition |
Author: | Valdivia Arriaza, Marc |
Director/Tutor: | Bolaños Solà, Marc |
Keywords: | Processament digital d'imatges Visió per ordinador Programari Treballs de fi de grau Reconeixement de formes (Informàtica) Cartes (Restauració) Aprenentatge automàtic Digital image processing Computer vision Computer software Pattern recognition systems Menus Bachelor's theses Machine learning |
Issue Date: | 27-Jun-2018 |
Abstract: | [en] Food has become a very important aspect of our social activities. Since social networks and websites like Yelp appeared, their users have started uploading photos of their meals to the Internet. This factor leads to the development of food analysis models and food recognition. We propose a model to recognize the meal appearing in a picture from a list of menu items (candidates dishes). Which could serve for the recognize the selected meal in a restaurant. The system presented in this thesis does not need to train a new model for every new restaurant in a real case scenario. It learns to identify the components of an image and the relationship that they have with the name of the meal. The system introduced in this work computes the similarity between an image and a text sequence, which represents the name of the dish. The pictures are encoded using a combination of Convolutional Neural Networks to reduce the input image. While, the text is converted to a single vector applying a Long Short Term Memory network. These two vectors are compared and optimized using a similarity function. The similarity-based output is then used as a ranking algorithm for finding the most probable item in a menu list. According to the Ranking Loss metric, the results obtained by the model improve the baseline by a 15%. |
Note: | Treballs Finals de Grau d'Enginyeria Informàtica, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2018, Director: Marc Bolaños Solà |
URI: | http://hdl.handle.net/2445/132906 |
Appears in Collections: | Programari - Treballs de l'alumnat Treballs Finals de Grau (TFG) - Enginyeria Informàtica |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
codi_font.zip | Codi font | 380.39 kB | zip | View/Open |
memoria.pdf | Memòria | 4.61 MB | Adobe PDF | View/Open |
This item is licensed under a
Creative Commons License