Attention Guided Image-to-Image translation of Food Images Using GANs

Abstract

[en] Nowadays, with the help of the novel machine learning models, in particular Generative Adversarial Networks, we are able to generate synthetic media, which look absolutely realistic and at the same time authentic. Still, the food image-to-image translation remains a challenging problem that is very unexplored. Due to the complexity of food images the state of the art results are noisy and slow in convergence. In our work, we explore how adding attention to the image-to-image translation on food data can produce more realistic synthetic images and speed up the convergence of the algorithm. Furthermore, we present extensive analysis of GANs for food image synthesis and discuss several possible improvements over the base methodology sharing our insights on this problem. The source code that has been used to produce the results in this project can be found in our GitLab repository: https://gitlab.com/deep-food-ub/food-gan.