Amb motiu del tancament d'estiu, la validació de documents es reprendrà a partir del 28 d'agost de 2026. Disculpeu les molèsties.
Con motivo del cierre de verano, la validación de documentos se reanudará a partir del 28 de agosto de 2026. Disculpad las molestias
Due to the summer closure, document validation will resume starting August 28, 2026. We apologize for any inconvenience.

Files

memoria.pdf (1.68 MB)
src.zip (6.17 MB)

Document type

Bachelor thesis

Publication date

2013-06

Publication license

memòria: cc-by-nc-sa (c) Alberto Huélamo Segura, 2013
Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/47608

K-means web clustering amb Hadoop MapReduce

Journal Title

Authors

Director/Tutor

Journal ISSN

Volume Title

Related resource

Abstract

This paper proposes a solution to the problem of clustering large amount of web documents. The Hadoop framework, implementation of MapReduce distributed programming paradigm, developed by Google, plays a very important role in this field due to its scalability and ease to parallelize software. This is the reason why it is used in this project. Meanwhile, K-means clustering algorithm is easily adaptable to MapReduce programming model and provides proper results for web documents. The documents will be represented as a frequence vectors of terms and keywords and this is what algorithm needs to work. The developed software uses Hadoop in order to perform both tasks which make up the overall process: document processing and the clustering. Web documents are in HTML, which is not suitable for K-means. It is necessary preprocess them to extract descriptors and to pass them to the clustering algorithm. This is the first part of the process. The second part, K-means on Hadoop, goes beyond typical Hadoop execution, using most of the tools which Hadoop provides to make document clusters, from descriptors obtained from first part of the process.

Description

Treballs Finals de Grau d'Enginyeria Informàtica, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2013, Director: Eloi Puertas i Prats

Subject

Anàlisi de conglomerats, Processament distribuït de dades, Programari, Treballs de fi de grau

Subject (English)

Cluster analysis, Distributed processing in electronic data processing, Computer software, Bachelor's theses

Citation

Collections

Treballs Finals de Grau (TFG) - Enginyeria Informàtica
Programari - Treballs de l'alumnat

Citation

HUÉLAMO SEGURA, Alberto. K-means web clustering amb Hadoop MapReduce. [consulted: 16 of August of 2026]. Available at: https://hdl.handle.net/2445/47608

Export metadata

JSON - METS

Share record