Equal Quality for Online and Lab Data: A Direct Comparison from Two Dual-Task Paradigms
Abstract: Conducting behavioral experiments online has become more prevalent recently. Still, there is reluctance to embrace the possibilities this technology has to offer. So far, only simple tasks have been replicated in an online setting. In order to investigate whether collecting online also leads to high quality data in demanding tasks, we directly compared data collected in the lab with data collected online from a demanding dual-task paradigm and a psychological refractory period paradigm. In Experiment 1, we recruited from local pools, online and offline; in Experiment 2, we collected lab data from our local pool and online data from a remote commercial participant platform. We found that all relevant effects were replicated in the lab and online settings; effect sizes were similar. Additionally, most response time distributions were even statistically equivalent when comparing online and lab data. Thus, online effect sizes and variances can be comparable to lab-based data. Online studies are time-efficient and recruiting an online sample instead or on top of a laboratory sample should be considered for basic behavioral research. This can serve an important role in the generalizability and replicability of findings in the cognitive and behavioral sciences.
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Bibliographic citation
-
Equal Quality for Online and Lab Data: A Direct Comparison from Two Dual-Task Paradigms ; volume:4 ; number:1 ; year:2022 ; pages:47-59 ; extent:13
Open psychology ; 4, Heft 1 (2022), 47-59 (gesamt 13)
- Creator
-
Sauter, Marian
Stefani, Maximilian
Mack, Wolfgang
- DOI
-
10.1515/psych-2022-0003
- URN
-
urn:nbn:de:101:1-2022072014234912450303
- Rights
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
15.08.2025, 7:37 AM CEST
Data provider
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
- Sauter, Marian
- Stefani, Maximilian
- Mack, Wolfgang
Other Objects (12)
Costs and advantages in bimodal bilingual language production: Language-switching and dual-task paradigms
A current view on dual-task paradigms and their limitations to capture cognitive load
Investigating Task-Order Coordination in Dual-Task Situations
Determinants of task order in dual-task situations
Expanding dual-task research by a triple-task
Parallel memory retrieval in dual-task situations?
Modeling test learning and dual-task dissociations
Dual-Task Performance in GBA Parkinson's Disease
Introspection about backward crosstalk in dual-task performance
A conceptual review of lab-based aggression paradigms
On the mechanisms improving dual-task performance with pratice
Dual-Task Performance in GBA Parkinson’s Disease
Costs and advantages in bimodal bilingual language production: Language-switching and dual-task paradigms
A current view on dual-task paradigms and their limitations to capture cognitive load
Investigating Task-Order Coordination in Dual-Task Situations
Determinants of task order in dual-task situations
Expanding dual-task research by a triple-task
Parallel memory retrieval in dual-task situations?
Modeling test learning and dual-task dissociations
Dual-Task Performance in GBA Parkinson's Disease
Introspection about backward crosstalk in dual-task performance
A conceptual review of lab-based aggression paradigms
On the mechanisms improving dual-task performance with pratice
Dual-Task Performance in GBA Parkinson’s Disease
Costs and advantages in bimodal bilingual language production: Language-switching and dual-task paradigms
A current view on dual-task paradigms and their limitations to capture cognitive load
Investigating Task-Order Coordination in Dual-Task Situations
Determinants of task order in dual-task situations
Expanding dual-task research by a triple-task
Parallel memory retrieval in dual-task situations?
Modeling test learning and dual-task dissociations
Dual-Task Performance in GBA Parkinson's Disease
Introspection about backward crosstalk in dual-task performance
A conceptual review of lab-based aggression paradigms
On the mechanisms improving dual-task performance with pratice