Document type

Article

Version

Accepted version

Publication date

All rights reserved

Please use this identifier to cite or link to this item: https://hdl.handle.net/2445/182481

The influence of hidden researcher decisions in applied microeconomics

Journal Title

Director/Tutor

Journal ISSN

Volume Title

Abstract

Researchers make hundreds of decisions about data collection, preparation, and analysis in their research. We use a many‐analysts approach to measure the extent and impact of these decisions. Two published causal empirical results are replicated by seven replicators each. We find large differences in data preparation and analysis decisions, many of which would not likely be reported in a publication. No two replicators reported the same sample size. Statistical significance varied across replications, and for one of the studies the effect's sign varied as well. The standard deviation of estimates across replications was 3-4 times the mean reported standard error.

Citation

Citation

HUNTINGTON-KLEIN, Nick, et al. The influence of hidden researcher decisions in applied microeconomics. Economic Inquiry. 2021. Vol. 59, num. 3, pags. 944-960. ISSN 0095-2583. [consulted: 18 of June of 2026]. Available at: https://hdl.handle.net/2445/182481

Export metadata

JSON - METS

Share record