Spurious precision in meta-analysis

Arbeitspapier

Meta-analysis upweights studies reporting lower standard errors and hence more precision. But in empirical practice, notably in observational research, precision is not given to the researcher. Precision must be estimated, and thus can be p-hacked to achieve statistical significance. Simulations show that a modest dose of spurious precision creates a formidable problem for inverse-variance weighting and bias-correction methods based on the funnel plot. Selection models fail to solve the problem, and the simple mean can beat sophisticated estimators. Cures to publication bias may become worse than the disease. We introduce an approach that surmounts spuriousness: the Meta-Analysis Instrumental Variable Estimator (MAIVE), which employs inverse sample size as an instrument for reported variance.

Angaben zum Objekt

• Sprache: Englisch

Verweise und Beziehungen

• Erschienen in: Series: IES Working Paper ; No. 5/2023

Klassifikation und Themen

• Klassifikation: Wirtschaft ; Statistical Simulation Methods: General ; Single Equation Models: Single Variables: Instrumental Variables (IV) Estimation ; Survey Methods; Sampling Methods
• Thema: Publication bias ; p-hacking ; selection models ; meta-regression ; funnel plot ; inverse-variance weighting

Beteiligte, Orts- und Zeitangaben

• Ereignis: Geistige Schöpfung
• (wer): Havránková, Zuzana ; Bom, Pedro R. D. ; Havránek, Tomáš ; Rachinger, Heiko
• Ereignis: Veröffentlichung
• (wer): Charles University in Prague, Institute of Economic Studies (IES)
• (wo): Prague
• (wann): 2023

Weitere Informationen

• Handle: http://hdl.handle.net/10419/286334
• Letzte Aktualisierung: 10.03.2025, 11:44 MEZ