Please use this identifier to cite or link to this item: http://hdl.handle.net/2445/102884
Title: Proposta per a una arquitectura escalable d'ingesta de missatges
Author: López Sánchez, Oriol
Director: Garrido Ostermann, Lluís
Keywords: Processament de dades
Arquitectura orientada a serveis (Informàtica)
Programari
Tesis
Dades massives
Data processing
Service-oriented architecture (Computer science)
Computer software
Theses
Big data
Issue Date: 30-Jun-2016
Abstract: Our world is becoming more interconnected with everything. As time passes, more electronic components emit information to the Internet. Mobile devices, intelligent wearables, beacons, any kind of machine with enough electricity to connect to the Internet may send information of its surroundings. At Beabloo, we strive to achieve a higher understanding of the environment these devices describe us by listening them. As the amount of these devices increases, harnessing such high amount of information becomes difficult, and we believe it is necessary to study new ways that allow us scale up horizontally, and allows us to bring such information as fast as possible to our data processing pipelines, which then are being used to calculate Key Performance Indicators that will be used for decision making at higher level. This paper describes a design of a data ingression architecture, keeping in mind previous design flaws that slowed down ingestion capacity. Its objective is, by keeping a small and minimalistic architecture design, to allow attaining an almost real-time data processing performance. The project uses Apache Kafka, and Apache Storm to achieve a new real-time execution environment, and to be able to evaluate its performance, it uses Prometheus to store performance metrics and Grafana to visualize them with ease.
Note: Treballs Finals de Grau d'Enginyeria Informàtica, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2016, Director: Lluís Garrido Ostermann
URI: http://hdl.handle.net/2445/102884
Appears in Collections:Programari - Treballs de l'alumnat
Treballs Finals de Grau (TFG) - Enginyeria Informàtica

Files in This Item:
File Description SizeFormat 
memoria.pdfMemòria948.52 kBAdobe PDFView/Open
codi_font.zipCodi font228.13 MBzipView/Open


This item is licensed under a Creative Commons License Creative Commons