Interactive Experiments in Toloka

Arbeitspapier

The popularity of online behavioral experiments grew steadily even before the COVID-19 pandemic. With the start of lockdowns, online studies were often the only available option for the behavioral economists, sociologists and political scientists. The usage of most well-known platforms such as mTurk was so intensive that it harmed the quality of data. But even before the pandemics-induced quality crisis, online studies were limited in scope, since real-time interactions between participants were hard to achieve due to the large proportion of drop-outs and issues with creating stable groups. Using the crowdsourcing platform Toloka, we successfully ran several multi-round interactive experiments. Toloka’s large online audience, relatively low exposure of participants to sociological surveys and behavioral studies, and a convenient application programming interface makes it a perfect tool to run behavioral studies that require real-time interactions of participants.

Object Details

• Language: Englisch

Classification and Topics

• Classification: Wirtschaft ; Design of Experiments: General ; Design of Experiments: Laboratory, Group Behavior ; Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access ; Data Collection and Data Estimation Methodology; Computer Programs: Other Computer Software ; Economic Methodology
• Subject: Crowdsourcing ; survey research ; MTurk ; online research

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Chapkovski, Philipp
• Event: Veröffentlichung
• (who): SSRN
• (where): Rochester
• (when): 2022

Further information

• DOI: doi:10.2139/ssrn.3727227
• Handle: http://hdl.handle.net/10419/249771
• Last update: 10.03.2025, 11:44 AM CET