Validity and Judgment Bias in Visual Analysis of Single-Case Data
Abstract: Analysis of data from single-case intervention studies commonly involves visual analysis. Previous research indicates that visual analysis may suffer from low reliability and unprom- ising error rates. We investigated the reliability and validity of visual analysis and explored to what extent data trends affect judgments. We administered a within-subject experiment in which 186 teacher-education students visually analyzed specifically constructed single-case graphs that included either an intervention effect, a trend effect, both effects, or no effect. Participants identified intervention effects in 75% of the graphs, regardless of the existence of a trend. Type I error rates were low (5%) in graphs without a trend but increased fivefold (25%) for graphs with a trend. Inter- and intra-rater reliability was low, particularly when a trend was present in the data. https://journals.ub.uni-koeln.de/index.php/IJRLD/article/view/1884
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Bibliographic citation
-
Validity and Judgment Bias in Visual Analysis of Single-Case Data ; volume:5 ; number:1 ; year:2021
International journal for research in learning disabilities ; 5, Heft 1 (2021)
- Creator
-
Wilbert , Jürgen
Bosch , Jannis
Lüke , Timo
- URN
-
urn:nbn:de:101:1-2406131446343.802315681294
- Rights
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
14.08.2025, 10:55 AM CEST
Data provider
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
- Wilbert , Jürgen
- Bosch , Jannis
- Lüke , Timo
Other Objects (12)
Diagnostic Competencies of Teachers: Accuracy of Judgment, Sources of Bias, and Consequences of (Mis-)Judgment
Teacher judgment validity : judgments of competencies and of cognitive abilities
Discrimination learning and judgment bias in low birth weight pigs
Subjective Judgment and Gender Bias in Advice: Evidence from the Laboratory
Collective judgment predicts disease-associated single nucleotide variants
Kafka: The Judgment ; Judgment without trial?
Supplemental Judgment
Attitudinal judgment
Racial bias and the validity of the Implicit Association Test
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts
The construct and predictive validity testing of Indonesian entrepreneurial competence inventory-situational judgment test model
Diagnostic Competencies of Teachers: Accuracy of Judgment, Sources of Bias, and Consequences of (Mis-)Judgment
Teacher judgment validity : judgments of competencies and of cognitive abilities
Discrimination learning and judgment bias in low birth weight pigs
Subjective Judgment and Gender Bias in Advice: Evidence from the Laboratory
Collective judgment predicts disease-associated single nucleotide variants
Kafka: The Judgment ; Judgment without trial?
Supplemental Judgment
Attitudinal judgment
Racial bias and the validity of the Implicit Association Test
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts
The construct and predictive validity testing of Indonesian entrepreneurial competence inventory-situational judgment test model
Diagnostic Competencies of Teachers: Accuracy of Judgment, Sources of Bias, and Consequences of (Mis-)Judgment
Teacher judgment validity : judgments of competencies and of cognitive abilities
Discrimination learning and judgment bias in low birth weight pigs
Subjective Judgment and Gender Bias in Advice: Evidence from the Laboratory
Collective judgment predicts disease-associated single nucleotide variants
Kafka: The Judgment ; Judgment without trial?
Supplemental Judgment
Attitudinal judgment
Racial bias and the validity of the Implicit Association Test
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts
Effects of reading instructions on pre-service teachers’ judgment bias when learning from texts