International large-scale assessments are now part of the educational landscape in many countries and often feed into major policy decisions. Yet, such assessments also provide data sets for secondary analysis that can address key issues of concern to educators and policymakers alike. Traditionally, such secondary analyses have been based on a…

It is so easy to criticize the SAT that most observers overlook the weaknesses of its architect, the College Board. This author contents that, until the latter is replaced, however, the former will never be fixed. The College Board has every incentive to create a complex, stressful, expensive college admissions system. Because it is accountable to…

Drawing on the Programme for International Student Assessment 2003 data set comprising over 190,000 15-year-old students in 25 countries, the current study sought to examine the role of arts-related information and communication technology (ICT) use in students' problem-solving skill and science and mathematics achievement. Structural equation…

This mixed-methods case study focuses on the third through fifth grade classrooms at a public elementary school in a Midwestern urban school district where the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) assessment is being implemented. According to the school district, the goals of these tests are: to show…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

After many equatings have been conducted in a testing program, equating errors can accumulate to a degree that is not negligible compared to the standard error of measurement. In this paper, the author investigates the asymptotic accumulative standard error of equating (ASEE) for linear equating methods, including chained linear, Tucker, and…

In this technical report, we present the results of a reliability study of the sixth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

This study examined the feasibility of administering GED Tests using a computer based testing system with embedded accessibility tools and the impact on test scores and test-taker experience when GED Tests are transitioned from paper to computer. Nineteen test centers across five states successfully installed the computer based testing program,…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement…

This paper examines the re-articulation of social justice as equity in schooling policy through national and global testing and data infrastructures. It focuses on the Australian National Assessment Program--Literacy and Numeracy (NAPLAN) and the OECD's Programme for International Student Assessment (PISA). We analyse the discursive reconstitution…

Despite a pending policy change aimed at including more students with disabilities and English-language learners (ELLs) in the "nation's report card," the federal agency that administers the national testing program appears to be softening the penalty for states that fail to improve inclusion rates. The disagreement underscores the…

In order to remain relevant and useful, testing programs must periodically update their tests to match shifts in student populations and school curricula. One might think that because the publishers are offering a product, the responsibility for updates rests entirely on them. Publishers conduct studies to assure new content is appropriate. But…