PISA aims to serve as a "global yardstick" for educational success, as measured by student performance. For comparisons to be meaningful across countries or over time, PISA samples must be representative of the population of 15-year-old students in each country. Exclusions and non-response can undermine this representativeness and…

This paper compares the learning gain over one year of schooling among 15-year-old students in Austria and Scotland (United Kingdom). Common metrics for reading, mathematics and science learning, as established by the Programme for International Student Assessment (PISA), are used. In order to overcome the limitations of a cross-sectional,…

PISA [Programme for International Student Assessment] will be in the news again this year. The 2018 results are due to be released at the end of 2019 and they usually generate media interest. This Rangahau Whakarapopoto is a research brief which outlines things to watch out for as you think about what the results might mean.

Computer-based assessments allow practitioners to collect rich process data by logging students' interactions with assessment tasks. In addition to providing final responses to test questions, computer-based assessments promise to furnish more evidence to support claims about what a student knows and can do through logging process data in log…

Research suggests that a country does not need inequity to have high performance. However, such research has potentially suffered from confounders present in between-country comparative research (e.g., latent cultural differences). Likewise, relatively little consideration has been given to whether the situation may be different for high- or…

In a radical school choice reform in 1992, Sweden's education system was opened to private competition from independent for-profit and non-profit schools funded by vouchers. Competition was expected to produce higher-quality education at lower cost, in both independent and public schools. This two-pronged study first examines to what extent the…

Standardised tests help measure student's progress at school and can inform education policy about existing shortfalls. However, too much testing could lead to much pressure on students and teachers to learn and teach for a test, something that would take the joy out of the learning process. Many parents and educators are all too familiar with…

The gender gap reversal in educational attainment is ubiquitous in high-income countries, as well as in a growing share of low- and middle-income countries. To account for the reversal, this paper proposes a theoretical framework in which the interplay between the distributions of academic aptitudes and changes in the net benefits of schooling…

Do students make their best effort in large-scale assessment studies such as the "Programme for International Student Assessment" (PISA)? Despite six cycles of PISA surveys from 2000 to 2015, empirical studies regarding students' test motivation and experience of the tests are sparse. The present study examines students' test motivation…

Independent schools are, for the most part, exempt from mandatory participation in standardized tests designed for state and federal comparisons, nor are they required to take part in comparative international assessments. The anxiety in the broader culture, however, is driving a growing interest among independent school parents (and prospective…

Using an empirically-based simulation study, we show that typically used methods of choosing an item calibration sample have significant impacts on achievement bias and system rankings. We examine whether recent PISA accommodations, especially for lower performing participants, can mitigate some of this bias. Our findings indicate that standard…

This article examines inequality in different dimensions of student academic achievement (math, science, and reading) by family background and school context in three East Asian (Taiwan, Japan, and South Korea) and three Western (United States, Germany, and the Czech Republic) nations. Building on Hauser (2009), we develop a novel…

The Program for International Student Assessment (PISA) is a system of international assessments that allows countries to compare outcomes of learning as students near the end of compulsory schooling. PISA measures the performance of 15-year-old students in science, reading, and mathematics literacy every 3 years. PISA uses the term…

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…