Insights into survey errors of large scale educational achievement surveys

Arbeitspapier

While educational achievement surveys revolutionised research on education cross-nationally, the surveys have been repeatedly subject of heated debate since first results were published. This paper reviews existing research examining the design and methodology of educational achievement surveys. Results are reported by allocating them to the specific survey error component of achievement estimates they address. Different error components from the design, collection, processing and analysis of survey data constitute the total survey error, which is an error difficult to quantify but important for assessing the overall accuracy of the surveys’ achievement estimates. The review shows that there are many reasons to assume that the total survey error associated with countries’ educational achievement estimates is likely to be inflated by other errors besides the standard error reported by survey organisers. Given the policy relevance of the surveys’ estimates, policy makers and the research community would greatly benefit from survey organisers providing more transparency on the different potential errors of educational achievement estimates. Without this information the debate about the fitness of educational achievement data for policy making is unlikely to dissolve.

Object Details

• ISBN: 978-92-79-85795-9
• Language: Englisch

References and Relationships

• Bibliographic citation: Series: JRC Working Papers in Economics and Finance ; No. 2018/5

Classification and Topics

• Classification: Wirtschaft ; Education and Research Institutions: General ; Analysis of Education ; Survey Methods; Sampling Methods
• Subject: educational achievement surveys ; survey methodology ; survey errors ; PISA ; TIMSS ; PIRLS

Contributors, Places and Time

• Event: Geistige Schöpfung
• (who): Schnepf, Sylke
• Event: Veröffentlichung
• (who): Publications Office of the European Union
• (where): Luxembourg
• (when): 2018

Further information

• DOI: doi:10.2760/219007
• Handle: http://hdl.handle.net/10419/202297
• Last update: 10.03.2025, 11:43 AM CET