Document type
ArticleVersion
Published versionPublication date
Publication license
Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/172863
A Robust Solution to Variational Importance Sampling of Minimum Variance
Journal Title
Director/Tutor
Journal ISSN
Volume Title
Related resource
Abstract
Importance sampling is a Monte Carlo method where samples are obtained from an alternative proposal distribution. This can be used to focus the sampling process in the relevant parts of space, thus reducing the variance. Selecting the proposal that leads to the minimum variance can be formulated as an optimization problem and solved, for instance, by the use of a variational approach. Variational inference selects, from a given family, the distribution which minimizes the divergence to the distribution of interest. The Rényi projection of order 2 leads to the importance sampling estimator of minimum variance, but its computation is very costly. In this study with discrete distributions that factorize over probabilistic graphical models, we propose and evaluate an approximate projection method onto fully factored distributions. As a result of our evaluation it becomes apparent that a proposal distribution mixing the information projection with the approximate Rényi projection of order 2 could be interesting from a practical perspective.
Citation
Citation
HERNÁNDEZ-GONZÁLEZ, Jerónimo and CERQUIDES BUENO, Jesús. A Robust Solution to Variational Importance Sampling of Minimum Variance. Entropy. 2020. Vol. 22, num. 12, pags. 1405. ISSN 1099-4300. [consulted: 16 of June of 2026]. Available at: https://hdl.handle.net/2445/172863