Online Belief Elicitation Methods

Arbeitspapier

We evaluate the quality of beliefs elicited from online respondents, comparing several characteristics of two widely used elicitation mechanisms (the Binarized Scoring Rule - BSR - and a stochastic variation of the Becker-deGroot-Marshak mechanism -BDM) against a flat fee baseline for a variety of beliefs (induced probabilities, first-order factual knowledge, second-order knowledge of others). We find the flat-fee method is the most time-efficient, the BDM is the most difficult to understand, and there are no differences in the average accuracy of induced beliefs across conditions. However, the methods are significantly different in terms of the frequency of first-order and second-order beliefs reported at exactly 50%: the flat-fee method leads to the most mass on this belief, followed by BDM and BSR. We also find that incentives increase accuracy for less-educated participants, and that attention, numeracy, and education are positively associated with the quality of induced beliefs across methods. Our results suggest that the quality of beliefs elicited in online environments may depend less on the formal incentive compatibility properties of the elicitation procedure (whether the procedure prevents “dishonest” reporting) than on the difficulty of comprehending the task and how well incentives induce cognitive effort (thereby inducing subjects to quantify or construct their beliefs).

Angaben zum Objekt

• Sprache: Englisch

Verweise und Beziehungen

• Erschienen in: Series: CESifo Working Paper ; No. 8823

Klassifikation und Themen

• Klassifikation: Wirtschaft ; Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access ; Data Collection and Data Estimation Methodology; Computer Programs: Other ; Search; Learning; Information and Knowledge; Communication; Belief; Unawareness ; Micro-Based Behavioral Economics: Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making‡
• Thema: belief elicitation ; incentives ; online experiment

Beteiligte, Orts- und Zeitangaben

• Ereignis: Geistige Schöpfung
• (wer): Burdea, Valeria ; Woon, Jonathan
• Ereignis: Veröffentlichung
• (wer): Center for Economic Studies and Ifo Institute (CESifo)
• (wo): Munich
• (wann): 2021

Weitere Informationen

• Handle: http://hdl.handle.net/10419/232420
• Letzte Aktualisierung: 10.03.2025, 11:44 MEZ