Tipus de document
Treball de fi de màsterData de publicació
Llicència de publicació
Si us plau utilitzeu sempre aquest identificador per citar o enllaçar aquest document: https://hdl.handle.net/2445/232256
Comprehensive Format Benchmark for Recommender SystemWorkloads
Títol de la revista
Autors
Director/Tutor
Contribució addicional
ISSN de la revista
Títol del volum
Resum
Choosing a file format for training data is usually a routine technical decision based on experience or common practice, without much understanding of how it affects later stages of the process. This thesis explores those effects for implicit-feedback recommender systems by comparing five file formats: CSV, Parquet, ORC, Arrow IPC, and Lance, across the entire workflow, from data storage to the quality of the final trained model, using $\sim 15,\mathrm{M}$ MovieLens ratings obtained from the original file with $\sim 32,\mathrm{M}$ rating.
Three studies are presented. The first evaluates the data-loading lifecycle by breaking read time into raw I/O, decoding, and materialization stages, and measures the fraction of time attributable to file format, denoted by $f$, across four recommender models with increasing computational cost. The second develops a predictive cost model of the form $T_{read}=\alpha_f+\beta_1 g N+\beta_2 g N \log_2 N$ using nine calibration dataset sizes and validates it on an out-of-core dataset with synthetic and real data. The third study examines how file format choice affects recommendation quality by linking it directly to the NDCG@10 metric.
Two key findings emerge. The first is a ranking inversion: the format that is best for storage efficiency (ORC+zstd, which is $\sim 5\times$ smaller than CSV) is not the fastest format for reading data. The second is a regime flip: when the entire dataset fits in memory, the format-attributable fraction $f$ approaches zero as the number of training epochs increases, meaning that file format has little impact on long training runs. In contrast, when training is performed out-of-core, $f$ remains constant, so file format continues to have a significant effect regardless of the number of epochs.
These effects also extend to recommendation quality. The time required to reach 95% of the maximum NDCG@10 is an affine function of read time, with a slope of $E_q=3$, which was verified exactly. As a result, the ranking inversion observed in runtime also appears when considering quality over time.
These results lead directly to practical recommendations. Arrow IPC is the preferred choice for repeated out-of-core training, ORC is best suited for long-term archival storage, and any columnar format is preferable to CSV when a dataset is read more than five times. The predictive model also makes these recommendations transferable across different hardware platforms, requiring only three parameters per format to be recalibrated. The notebooks used in this project can be found here https://github.com/decruz26/TFM.
Descripció
Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Raúl Cumplido Domínguez i Eloi Puertas i Prats
Recurs relacionat
Citació
Citació
CRUZ PÉREZ, Javier de. Comprehensive Format Benchmark for Recommender SystemWorkloads. [consulted: 17 of November of 2026]. Available at: https://hdl.handle.net/2445/232256