Arbeitspapier
The Robustness Reproducibility of the American Economic Review
We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p﹤0.05) varies between 17% and 88% across the papers with a mean of 46%. The mean relative t/z-value of the robustness tests varies between 35% and 87% with a mean of 63%, suggesting selective reporting of analytical specifications that exaggerate statistical significance. A sample of economists (n=359) overestimates robustness reproducibility, but predictions are correlated with observed reproducibility.
- Sprache
-
Englisch
- Erschienen in
-
Series: I4R Discussion Paper Series ; No. 124
- Klassifikation
-
Wirtschaft
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Campbell, Douglas
Brodeur, Abel
Dreber, Anna
Johannesson, Magnus
Kopecky, Joseph
Lusher, Lester
Tsoy, Nikita
- Ereignis
-
Veröffentlichung
- (wer)
-
Institute for Replication (I4R)
- (wo)
-
s.l.
- (wann)
-
2024
- Letzte Aktualisierung
-
10.03.2025, 11:41 MEZ
Datenpartner
Dieses Objekt wird bereitgestellt von:
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Arbeitspapier
Beteiligte
- Campbell, Douglas
- Brodeur, Abel
- Dreber, Anna
- Johannesson, Magnus
- Kopecky, Joseph
- Lusher, Lester
- Tsoy, Nikita
- Institute for Replication (I4R)
Entstanden
- 2024
Ähnliche Objekte (12)
Reproducibility and Robustness Replicability of Gsottbauer et al. (2022)
Robustness Reproducibility of "Improving Workplace Climate in Large Corporations: A Clustered Randomized Intervention"
The Empirical Economic Growth Literature: Robustness, Significance and Size
On the Robustness of Robustness Checks of the Environmental Kuznets Curve
The Egyptian economic & political review
Studies in Analytical Reproducibility: the Conquaire Project
The critical need to foster computational reproducibility
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
Improving the Robustness of Scagnostics
Turkish Economic Review: From the Editor
Robustness in civil engineering - influences of the structural model on the evaluation of the structural robustness
Reproducibility and Robustness Replicability of Gsottbauer et al. (2022)
Robustness Reproducibility of "Improving Workplace Climate in Large Corporations: A Clustered Randomized Intervention"
The Empirical Economic Growth Literature: Robustness, Significance and Size
On the Robustness of Robustness Checks of the Environmental Kuznets Curve
The Egyptian economic & political review
Studies in Analytical Reproducibility: the Conquaire Project
The critical need to foster computational reproducibility
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
Improving the Robustness of Scagnostics
Turkish Economic Review: From the Editor
Robustness in civil engineering - influences of the structural model on the evaluation of the structural robustness
Reproducibility and Robustness Replicability of Gsottbauer et al. (2022)
Robustness Reproducibility of "Improving Workplace Climate in Large Corporations: A Clustered Randomized Intervention"
The Empirical Economic Growth Literature: Robustness, Significance and Size
On the Robustness of Robustness Checks of the Environmental Kuznets Curve
The Egyptian economic & political review
Studies in Analytical Reproducibility: the Conquaire Project
The critical need to foster computational reproducibility
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
The robustness of the causal and economic relationship between construction flows and economic growth: evidence from Western Europe
Improving the Robustness of Scagnostics
Turkish Economic Review: From the Editor