Carregant...
Miniatura

Tipus de document

Treball de fi de màster

Data de publicació

Si us plau utilitzeu sempre aquest identificador per citar o enllaçar aquest document: https://hdl.handle.net/2445/200060

Sampling methods for activation correlation graphs to predict neural network generalization using topological data analysis

Títol de la revista

ISSN de la revista

Títol del volum

Recurs relacionat

Resum

[en] The performance of a deep neural network (DNN) is dependent on its ability to generalize. This ability is often expressed in the difference in accuracy on a training and test set, or the generalization gap. Recent research has seen the use of topological data analysis to estimate this performance gap without the use of a test set. Here, persistent homology measures are derived from a weighted graph of neuron activation correlations (functional network graph). The resulting persistence diagram is vectorized by a number of statistical summaries and correlated with the generalization gap. However, the computational complexity of persistent homology calculations hinders the application to DNNs with a larger number of activations. Methods are needed to sample these activations without losing predictive power. This work assesses the effect of different sampling strategies on the resulting persistence diagrams and their summaries. These include (non-)stratified random sampling, three methods based on notions of neuron importance similar to those used in pruning, and one using $k$-means++. In line with previous research some of these strategies provide models for predicting the generalization gap with high accuracy. The investigations provide insight and open up new lines of research into the structure of the functional network activation graph.

Descripció

Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Curs: 2022-2023. Tutor: Sergio Escalera Guerrero i Rubén Ballester Bautista

Citació

Citació

CARPAY, Otis. Sampling methods for activation correlation graphs to predict neural network generalization using topological data analysis. [consulta: 21 de gener de 2026]. [Disponible a: https://hdl.handle.net/2445/200060]

Exportar metadades

JSON - METS

Compartir registre