The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Data from international large-scale assessments (ILSAs) of schooled populations indicate that boys have considerably poorer literacy skills than girls. New evidence from a household-based ILSA--Organisation for Economic Cooperation and Development Survey of Adult Skills (PIAAC)--indicates that the gender gap in literacy is negligible, even though…

When scaling psychological tests with methods of item response theory it is necessary to investigate to what extent the responses correspond to the model predictions. In addition to the statistical evaluation of item misfit, the question arises as to its practical significance. Although item removal is undesirable for several reasons, its…

In 2015, the "Programme for International Student Assessment" (PISA) introduced multiple changes in its study design, the most extensive being the transition from paper- to computer-based assessment. We investigated the differences between German students' text responses to eight reading items from the paper-based study in 2012 to text…

Written instructions seldom need to be read when playing videogames. Instead, gaming often involves early information foraging and expansive exploration behaviors. We use data from the Programme for International Student Assessment (PISA) to explore whether students who regularly play videogames (daily gamers) adopt behaviors that are typical of…

We measure the effect of a single test practice on 15-year-old students' ability to solve mathematics problems using large, representative samples of the schooled population in 32 countries. We exploit three unique features of the 2012 administration of the Programme for International Student Assessment (PISA), a large-scale, low-stakes…

This paper compares the learning gain over one year of schooling among 15-year-old students in Austria and Scotland (United Kingdom). Common metrics for reading, mathematics and science learning, as established by the Programme for International Student Assessment (PISA), are used. In order to overcome the limitations of a cross-sectional,…

Given the ongoing development of computer-based tasks, there has been increasing interest in modelling students' behaviour indicators from log file data with contextual variables collected via questionnaires. In this work, we apply a latent regression model to analyse the relationship between latent constructs (i.e., performance, speed, and…

The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

Standardised tests help measure student's progress at school and can inform education policy about existing shortfalls. However, too much testing could lead to much pressure on students and teachers to learn and teach for a test, something that would take the joy out of the learning process. Many parents and educators are all too familiar with…

Gender differences in reading seem to increase throughout schooling and then decrease or even disappear with age, but the reasons for this are unclear. In this study, we explore whether differences in the way "reading literacy" is operationalised can add to our understanding of varying gender differences in international large-scale…

The gender gap reversal in educational attainment is ubiquitous in high-income countries, as well as in a growing share of low- and middle-income countries. To account for the reversal, this paper proposes a theoretical framework in which the interplay between the distributions of academic aptitudes and changes in the net benefits of schooling…

Do students make their best effort in large-scale assessment studies such as the "Programme for International Student Assessment" (PISA)? Despite six cycles of PISA surveys from 2000 to 2015, empirical studies regarding students' test motivation and experience of the tests are sparse. The present study examines students' test motivation…

Academic self-concept is positively related to individual achievement but negatively related to class- or school-average achievement: the big-fish--little-pond effect (BFLPE). This contrast effect results from social comparison processes. The BFLPE is known to be long-lasting, universal and robust. However, there is little evidence regarding its…

Are U.S. and, in particular, Hoosier students competitive and ready to succeed in an ever-changing and increasingly global economic landscape? This question is frequently considered by K-12 education stakeholders at all levels, including national, state, and local officials. One of the central ways in which education systems can compare themselves…