Arbeitspapier
Can the Replication Rate Tell Us About Selective Publication?
Selective publication is among the most-cited reasons for widespread replication failures. I show in a simple model of the publication process that the replication rate is completely unresponsive to the suppression of insignificant results. I then show that the expected replication rate falls below its intended target owing to issues with common power calculations in replication studies, even in the absence of other factors such as p-hacking or heterogeneous treatment effects. I estimate an empirical model to evaluate if issues with power calculations alone are sufficient to explain the low replication rates observed in large-scale replication studies. The model produces replication rate predictions (using only data from original studies) that are almost identical to observed replication rates in experimental economics and social science. In psychology, the model explains two-thirds of the gap between the replication rate and its intended target. I conclude by discussing alternative measures of replication that are more responsive to selective publication.
- Sprache
-
Englisch
- Erschienen in
-
Series: I4R Discussion Paper Series ; No. 3
- Klassifikation
-
Wirtschaft
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Vu, Patrick
- Ereignis
-
Veröffentlichung
- (wer)
-
Institute for Replication (I4R)
- (wo)
-
s.l.
- (wann)
-
2022
- Handle
- Letzte Aktualisierung
-
10.03.2025, 11:44 MEZ
Datenpartner
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Arbeitspapier
Beteiligte
- Vu, Patrick
- Institute for Replication (I4R)
Entstanden
- 2022
Ähnliche Objekte (12)
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments
![Tell me about yesterday [durchgestrichen] tomorrow](/assets/placeholder/searchResultMediaNoDigitisedMedia.png)
Tell me about yesterday [durchgestrichen] tomorrow
What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals?
Tell me about yesterday [crossed out] tomorrow
Braintrust: What Neuroscience Tells Us About Morality
Let's Be Selective about Migrant Self-Selection
Does pharmaceutical advertising affect journal publication about dietary supplements?
Does money growth tell us anything about inflation?
What can monetary policy tell us about Bitcoin?
What does nihilism tell us about modal logic?
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments
Tell me about yesterday [durchgestrichen] tomorrow
What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals?
Tell me about yesterday [crossed out] tomorrow
Braintrust: What Neuroscience Tells Us About Morality
Let's Be Selective about Migrant Self-Selection
Does pharmaceutical advertising affect journal publication about dietary supplements?
Does money growth tell us anything about inflation?
What can monetary policy tell us about Bitcoin?
What does nihilism tell us about modal logic?
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments
We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments
Tell me about yesterday [durchgestrichen] tomorrow
What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals?
Tell me about yesterday [crossed out] tomorrow
Braintrust: What Neuroscience Tells Us About Morality
Let's Be Selective about Migrant Self-Selection
Does pharmaceutical advertising affect journal publication about dietary supplements?
Does money growth tell us anything about inflation?
What can monetary policy tell us about Bitcoin?