Prior exposure to instructional manipulation checks does not attenuate survey context effects driven by satisficing or Gricean norms

Journal article | Zeitschriftenartikel

"Instructional manipulation checks (IMCs) are frequently included in unsupervised online surveys and experiments to assess whether participants pay close attention to the questions. However, IMCs are more than mere measures of attention - they also change how participants approach subsequent tasks, increasing attention and systematic reasoning. We test whether these previously documented changes in information processing moderate the emergence of response effects in surveys by presenting an IMC either before or after questions known to produce classic survey context effects. When the items precede an IMC, familiar satisficing as well as conversational effects replicate. More important, their pattern and size does not change when the items follow an IMC, in contrast to experiments with reasoning tasks. Given a power of 82% to 98% to detect an effect of d=.3, we conclude that prior exposure to an IMC is unlikely to increase or attenuate these types of context effects in surveys." (author's abstract)

Object Details

• ISSN: 2190-4936
• Extent: Seite(n): 195-220
• Language: Englisch
• Notes: Status: Veröffentlichungsversion; begutachtet (peer reviewed)

References and Relationships

• Bibliographic citation: Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 10(2)

Classification and Topics

• Subject: Sozialwissenschaften, Soziologie ; Erhebungstechniken und Analysetechniken der Sozialwissenschaften ; Umfrageforschung ; Erhebungsmethode ; Online-Befragung ; Datengewinnung ; Datenqualität ; Antwortverhalten ; Grundlagenforschung ; Methodenentwicklung

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Hauser, David J. ; Sunderrajan, Aashna ; Natarajan, Madhuri ; Schwarz, Norbert
• Event: Veröffentlichung
• (where): Deutschland
• (when): 2016

Further information

• DOI: https://doi.org/10.12758/mda.2016.008
• Rights: GESIS - Leibniz-Institut für Sozialwissenschaften. Bibliothek Köln
• Last update: 21.06.2024, 4:26 PM CEST