Background: In the context of large-scale educational assessments, the effort required to code open-ended text responses is considerably more expensive and time-consuming than the evaluation of multiple-choice responses because it requires trained personnel and long manual coding sessions. Aim: Our semi-supervised coding method eco (exploring…

One major challenge of longitudinal data analysis is to find an appropriate statistical model that corresponds to the theory of change and the research questions at hand. In the present article, we argue that "continuous-time models" are well suited to study the continuously developing constructs of primary interest in the education…

The aim of this study was to explore how the Coding as Another Language using ScratchJr (CAL-ScratchJr) curriculum, developed by Boston College's DevTech Research Group utilizing the ScratchJr app, impacted second grade students' computational thinking, coding skills, and reading comprehension. To accomplish this, the research team randomly…

Though proficiency with computation is highly emphasized in national mathematics standards, students with mathematics difficulty (MD) continue to struggle with computation. To learn more about the differences in computation error patterns between typically achieving students and students with MD, we assessed 478 third-grade students on a measure…

Though proficiency with computation is highly emphasized in national mathematics standards, students with mathematics difficulty (MD) continue to struggle with computation. To learn more about the differences in computation error patterns between typically achieving students and students with MD, we assessed 478 3rd-grade students on a measure of…

Poor sleep is thought to interfere with children's learning and academic achievement (AA). However, existing research and theory indicate there are factors that may mitigate the academic risk associated with poor sleep. The purpose of this study was to examine the moderating role of children's effortful control (EC) on the relation between sleep…

In light of disappointing scores on the Early Grade Reading Assessment (EGRA) and the Progress in International Reading Literacy Study (PIRLS), Arabic-speaking countries have begun to reexamine, and in some case reform, how they teach reading in the early grades. Egypt was one of the first countries to initiate early-grade reading reforms in 2010.…

The aim of this paper is to discuss the role of coding and observation manuals in classroom studies. While observation manuals have been a part of the methodological toolkit for measuring various aspects of instruction for decades, the field has also been suffering from "paradigm wars," fragmentation and local production of instruments.…

The current study aimed to examine the associations between teacher presence and social scaffolding and preschool children's peer interactions. Using a time sampling method, peer interactions of 22 four- and five-year-old preschoolers (12 girls; M[subscript age] = 52.95 months) and teacher behavior were observed on two different days during…

An emerging literature demonstrates that relevance interventions, which ask students to produce written reflections on how what they are learning relates to their lives, improve student learning outcomes. As part of a randomized evaluation of a relevance intervention (N = 1,978 students from 82 ninth-grade classes), we used Complier Average Causal…

We examined multimodality (the representation of information in multiple semiotic modes) in the context of international test comparisons. Using Program of International Student Assessment (PISA)-2009 data, we examined the correlation of the difficulty of science items and the complexity of their illustrations. We observed statistically…

One of the most basic and obvious sources of data for education policy analysis is text. This article discusses content analysis as an important part of the methodological toolbox for elucidating patterns and trends about education policy. Focusing specifically on media, I show how media content analysis can produce nuanced insights about the ways…

Background: Complexity models have provided a suitable framework in various domains to assess students' educational achievement. Complexity is often used as the analytical focus when regarding learning outcomes, i.e. when analyzing written tests or problem-centered interviews. Numerous studies reveal negative correlations between the complexity of…

Open-ended (OE) items are widely used to gather data on student performance in international achievement studies. However, several factors may threaten validity when using such items. This study examined Finnish coders' opinions about threats to validity when coding responses to OE items in the PISA 2012 problem-solving test. A total of 6…

Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the "Programme…