The Meaning of Failed Replications: A Review and Proposal

Arbeitspapier

The welcome rise of replication tests in economics has not been accompanied by a single, clear definition of replication. A discrepant replication, in current usage of the term, can signal anything from an unremarkable disagreement over methods to scientific incompetence or misconduct. This paper proposes an unambiguous definition of replication, one that reflects currently common but unstandardized use. It contrasts this definition with decades of unsuccessful attempts to standardize terminology, and argues that many prominent results described as replication tests – in labor, development, and other fields of economics – should not be described as such. Adopting this definition can improve incentives for researchers, encouraging more and better replication tests.

Object Details

• Language: Englisch

References and Relationships

• Bibliographic citation: Series: IZA Discussion Papers ; No. 9000

Classification and Topics

• Classification: Wirtschaft ; Economic Methodology: General ; Methodological Issues: General ; Data Collection and Data Estimation Methodology; Computer Programs: General
• Subject: replication ; robustness ; transparency ; open data ; ethics ; reproducible ; replicate ; misconduct ; fraud ; error ; code ; registry

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Clemens, Michael A.
• Event: Veröffentlichung
• (who): Institute for the Study of Labor (IZA)
• (where): Bonn
• (when): 2015

Further information

• Handle: http://hdl.handle.net/10419/110735
• Last update: 10.03.2025, 11:45 AM CET