Comprehensive Format Benchmark for Recommender SystemWorkloads

dc.contributor.advisorCumplido Domínguez, Raúl
dc.contributor.advisorPuertas i Prats, Eloi
dc.contributor.authorCruz Pérez, Javier de
dc.date.accessioned2026-10-22T11:28:11Z
dc.date.available2026-10-22T11:28:11Z
dc.date.issued2026-06-27
dc.descriptionTreballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Raúl Cumplido Domínguez i Eloi Puertas i Prats
dc.description.abstractChoosing a file format for training data is usually a routine technical decision based on experience or common practice, without much understanding of how it affects later stages of the process. This thesis explores those effects for implicit-feedback recommender systems by comparing five file formats: CSV, Parquet, ORC, Arrow IPC, and Lance, across the entire workflow, from data storage to the quality of the final trained model, using $\sim 15,\mathrm{M}$ MovieLens ratings obtained from the original file with $\sim 32,\mathrm{M}$ rating. Three studies are presented. The first evaluates the data-loading lifecycle by breaking read time into raw I/O, decoding, and materialization stages, and measures the fraction of time attributable to file format, denoted by $f$, across four recommender models with increasing computational cost. The second develops a predictive cost model of the form $T_{read}=\alpha_f+\beta_1 g N+\beta_2 g N \log_2 N$ using nine calibration dataset sizes and validates it on an out-of-core dataset with synthetic and real data. The third study examines how file format choice affects recommendation quality by linking it directly to the NDCG@10 metric. Two key findings emerge. The first is a ranking inversion: the format that is best for storage efficiency (ORC+zstd, which is $\sim 5\times$ smaller than CSV) is not the fastest format for reading data. The second is a regime flip: when the entire dataset fits in memory, the format-attributable fraction $f$ approaches zero as the number of training epochs increases, meaning that file format has little impact on long training runs. In contrast, when training is performed out-of-core, $f$ remains constant, so file format continues to have a significant effect regardless of the number of epochs. These effects also extend to recommendation quality. The time required to reach 95% of the maximum NDCG@10 is an affine function of read time, with a slope of $E_q=3$, which was verified exactly. As a result, the ranking inversion observed in runtime also appears when considering quality over time. These results lead directly to practical recommendations. Arrow IPC is the preferred choice for repeated out-of-core training, ORC is best suited for long-term archival storage, and any columnar format is preferable to CSV when a dataset is read more than five times. The predictive model also makes these recommendations transferable across different hardware platforms, requiring only three parameters per format to be recalibrated. The notebooks used in this project can be found here https://github.com/decruz26/TFM.
dc.format.extent19 p.
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/2445/232256
dc.language.isoeng
dc.rightsmemòria: cc-by-nc-nd (c) Cruz Pérez, Javier de, 2026
dc.rightscodi: GPL (c) nom, 2026
dc.rights.accessRightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.rights.urihttp://www.gnu.org/licenses/gpl-3.0.ca.html
dc.subject.classificationIntel·ligència artificial
dc.subject.classificationXarxes neuronals (Informàtica)
dc.subject.classificationAprenentatge profund
dc.subject.classificationProcessament de dades
dc.subject.classificationTreballs de fi de màster
dc.subject.classificationProgramari
dc.subject.otherArtificial intelligence
dc.subject.otherNeural networks (Computer science)
dc.subject.otherDeep learning (Machine learning)
dc.subject.otherData processing
dc.subject.otherMaster's thesis
dc.subject.otherComputer software
dc.titleComprehensive Format Benchmark for Recommender SystemWorkloads
dc.typeinfo:eu-repo/semantics/masterThesis

Fitxers

Paquet original

Mostrant 1 - 2 de 2
Carregant...
Miniatura
Nom:
TFM_Cruz_Perez_Javier_de.pdf
Mida:
269.48 KB
Format:
Adobe Portable Document Format
Carregant...
Miniatura
Nom:
Codi.zip
Mida:
507.09 KB
Format:
ZIP file