Document type
Bachelor thesisPublication date
Publication license
Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/211682
Sequential hypothesis testing in online controlled experiments
Journal Title
Authors
Director/Tutor
Journal ISSN
Volume Title
Related resource
Abstract
[en] This thesis explores the sequential analysis paradigm in the field of mathematical statistics, where sample size is not predetermined, allowing for adaptive decisionmaking. The first chapter outlines the theory’s oundations, particularly in sequential hypothesis testing, introducing the properties of two of the most relevant sequen-
tial tests: the Sequential Probability Ratio Test (SPRT) and the mixture Sequential Probability Ratio Test (mSPRT). The second chapter focuses on applying sequential hypothesis testing to online controlled experimentation, using Always Valid Inference. This alternative offers a statistically rigorous and efficient solution, potentially outperforming fixed-horizon methods. Empirical evidence of simulated real-world case-scenarios supports the proposed methodology’s advantages in online controlled experimentation.
Description
Treballs Finals de Grau de Matemàtiques, Facultat de Matemàtiques, Universitat de Barcelona, Any: 2024, Director: Josep Vives i Santa Eulàlia
Subject (English)
Citation
Collections
Citation
PÉREZ REVERTE, Arnau. Sequential hypothesis testing in online controlled experiments. [consulted: 8 of August of 2026]. Available at: https://hdl.handle.net/2445/211682