In a signal detection theory (SDT) approach to multiple choice exams, examinees are viewed as choosing, for each item, the alternative that is perceived as being the most plausible, with perceived plausibility depending in part on whether or not an item is known. The SDT model is a process model and provides measures of item difficulty, item…

The purpose of this paper is to briefly introduce two most common applications of multiple group item response theory (IRT) models, namely detecting differential item functioning (DIF) analysis and nonequivalent group score linking with a simultaneous calibration. We illustrate how to conduct those analyses using the "Stata" item…

Although the root-mean squared deviation (RMSD) is a popular statistical measure for evaluating country-specific item-level misfit (i.e., differential item functioning [DIF]) in international large-scale assessment, this paper shows that its sensitivity to detect misfit may depend strongly on the proficiency distribution of the considered…

The world demands bold action to meet the global goal of zero net emissions by 2050. Young people will experience the consequences of climate change more directly during their lifetime than any previous generation in recent history. Education can play a pivotal role in preparing new generations for a greener future. What students learn may mean…

This paper explains the rationale for updating the OECD Programme for International Student Assessment (PISA) 2021 questionnaire on Information and Communication Technology (ICT) and shows how it covers policy topics of current relevance. After presenting key findings based on previous ICT-related PISA data, the paper provides a summary of the…

Independent schools are, for the most part, exempt from mandatory participation in standardized tests designed for state and federal comparisons, nor are they required to take part in comparative international assessments. The anxiety in the broader culture, however, is driving a growing interest among independent school parents (and prospective…

The "PISA 2012 Technical Report" describes the methodology underlying the PISA 2012 survey, which tested 15-year-olds' competencies in mathematics, reading and science and, in some countries, problem solving and financial literacy. It examines the design and implementation of the project at a level of detail that allows researchers to…

This article introduces the essential features of the science component of 2006 Program for International Student Assessment (PISA). Administered every 3 years, PISA alternates emphasis on Reading, Mathematics, and Science Literacy. In 2006, PISA emphasized science. This article discusses PISA's definition of scientific literacy, the three…

Parents, students, teachers, school leaders, governments and the general public need good information on how well their education systems prepare students for life. A growing commitment by governments to monitor the outcomes of education systems in terms of student achievement on a regular basis and within an internationally agreed framework led…

The international OECD PISA [Programme for International Assessment] 2006 test focused on the performance of Sciences of 15 years old students. The unsatisfactory results from Mexico were submitted to analysis, including multilevel models, to explain the origin of their deficiencies. It was clear that a differential functioning behavior or a…

"Harvard Education Letter" is published bimonthly at the Harvard Graduate School of Education. This issue of "Harvard Education Letter" contains the following articles: (1) Online Testing, Version 1.0: Oregon's Adaptive Computer-Based Accountability Test Offers a Peek at a Brave New Future (Robert Rothman); (2) Beyond…

The Organisation for Economic Cooperation and Development's (OECD's) Programme for International Student Assessment (PISA) surveys, which take place every three years, have been designed to collect information about 15-year-old students in participating countries. PISA examines how well students are prepared to meet the challenges of the future,…

Since 1969, the National Assessment of Educational Progress (NAEP) has been the common yardstick for measuring the progress of students' education over time across the country. Teachers, principals, parents, policymakers, and researchers all use NAEP results to assess progress and develop ways to improve education in America. To make the…

This article presents key features of the mathematics assessment in OECD's Programme for International Student Assessment (PISA), from the point of view of the design of test items to fit in with the PISA mathematics framework. A brief description is first given to provide some background to the development of the PISA mathematics framework. The…