Background: In the context of large-scale educational assessments, the effort required to code open-ended text responses is considerably more expensive and time-consuming than the evaluation of multiple-choice responses because it requires trained personnel and long manual coding sessions. Aim: Our semi-supervised coding method eco (exploring…

One major challenge of longitudinal data analysis is to find an appropriate statistical model that corresponds to the theory of change and the research questions at hand. In the present article, we argue that "continuous-time models" are well suited to study the continuously developing constructs of primary interest in the education…

The aim of this paper is to discuss the role of coding and observation manuals in classroom studies. While observation manuals have been a part of the methodological toolkit for measuring various aspects of instruction for decades, the field has also been suffering from "paradigm wars," fragmentation and local production of instruments.…

We examined multimodality (the representation of information in multiple semiotic modes) in the context of international test comparisons. Using Program of International Student Assessment (PISA)-2009 data, we examined the correlation of the difficulty of science items and the complexity of their illustrations. We observed statistically…

One of the most basic and obvious sources of data for education policy analysis is text. This article discusses content analysis as an important part of the methodological toolbox for elucidating patterns and trends about education policy. Focusing specifically on media, I show how media content analysis can produce nuanced insights about the ways…

Open-ended (OE) items are widely used to gather data on student performance in international achievement studies. However, several factors may threaten validity when using such items. This study examined Finnish coders' opinions about threats to validity when coding responses to OE items in the PISA 2012 problem-solving test. A total of 6…

Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the "Programme…

The COACTIV video study is part of the COACTIV research program in which secondary mathematics teachers whose students participated in PISA 03/04 were examined, with respect to their professional knowledge, motivational orientations, beliefs, and self-regulation. In the video study, 284 German secondary mathematics teachers were asked to specify…

This article examines gender gaps in academic performance (grades in mathematics and reading) between boys and girls of ninth-grade elementary schools in the Czech Republic. Our analysis is based on 2003 data from the Programme for International Student Assessment, encompassing the academic performance and family background of ninth-grade pupils.…

The "PISA 2012 Technical Report" describes the methodology underlying the PISA 2012 survey, which tested 15-year-olds' competencies in mathematics, reading and science and, in some countries, problem solving and financial literacy. It examines the design and implementation of the project at a level of detail that allows researchers to…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

The 7th International Conference on Education Data Mining held on July 4th-7th, 2014, at the Institute of Education, London, UK is the leading international forum for high-quality research that mines large data sets in order to answer educational research questions that shed light on the learning process. These data sets may come from the traces…