Conceptions are contextual. In the realm of education, conceptions of various constituent groups are often shaped over a period of a number of years during which time these groups have participated in educational endeavors. Specifically, conceptions of assessment are influenced by beliefs, actions, attitudes, understandings, and past experiences.…

Purpose: The purpose of this study was to examine the college-readiness rates of Black, Hispanic, White, and Asian graduates of public secondary schools in Texas using archival data from the Texas Education Agency Academic Excellence Indicator System. Data examined were the average ACT and SAT scores for the past 10 school years (i.e., 2001-2002…

Student responses to the West Virginia Educational Standards Test (WESTEST) 2 Online Writing Assessment are scored by a computer-scoring engine. The scoring method is not widely understood among educators, and there exists a misperception that it is not comparable to hand scoring. To address these issues, the West Virginia Department of Education…

Automated Essay Scoring (AES) has garnered a great deal of attention from the rhetoric and composition/writing studies community since the Educational Testing Service began using e-rater[R] and the "Criterion"[R] Online Writing Evaluation Service as products in scoring writing tests, and most of the responses have been negative. While the…

The way forward to better assessment begins with the conception of assessment not as a single test but as a coherent "system" of measures. Coherent systems must be composed of valid measures of learning and be horizontally, developmentally, and vertically aligned to serve classroom, school, and district improvement. Coherent assessment…

This article presents the author's commentary on "Updating the Duplex Design for Test-Based Accountability in the Twenty-First Century," in which Isaac I. Bejar and E. Aurora Graf propose the application of a test design--the duplex design (which was proposed in 1988 by Bock and Mislevy) for application in current accountability assessments.…

Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…

This paper provides a snapshot of educational measurement professionals--their educational, professional and demographic backgrounds, as well as their workplace settings, job tasks, professional involvement, and compensation practices. Two previous studies have surveyed employers, but this is the first attempt to conduct a comprehensive survey of…

Differential item functioning (DIF) analysis is a key component in the evaluation of the fairness and validity of educational tests. The goal of this project was to review the status of ETS DIF analysis procedures, focusing on three aspects: (a) the nature and stringency of the statistical rules used to flag items, (b) the minimum sample size…

Measuring a teacher's effectiveness in quantifiable ways is a logical step in a society driven by the SMART goals (specific, measurable, attainable, relevant, and timely objectives) that pervade modern management. The idea of using student performance on standardized tests to judge a teacher's effectiveness picked up steam after the Obama…

The Australian Council for Educational Research (ACER) is one of the world's leading educational research centres. ACER's mission is to create and promote research-based knowledge, products and services that can be used to improve learning across the life span. This annual report describes ACER's milestones and accomplishments for the 2013-2014…

Since the time of Sputnik, American educators and policymakers have recognized the need to raise expectations by increasing rigor in high schools across the United States. Copious studies attest to the fact that students who take Advanced Placement coursework experience success in college (Adelman, 1999; Camara, 2003; College Board, 2005;…

Value-added models measure teacher performance by the test score gains of their students, adjusted for a variety of factors such as the performance of students when they enter the class. The measures are based on desired student outcomes such as math and reading scores, but they have a number of potential drawbacks. One of them is the…

This paper investigates the extent to which spring-to-spring testing timelines bias teacher value-added as a result of conflating summer and school-year learning. Using a unique dataset that contains both fall and spring standardized test scores, the author examines the patterns in school-year versus summer learning. She estimates value-added…

When using IRT models in Educational Achievement Testing, the model is as a rule too simple to catch all the relevant dimensions in the test. It is argued that a simple model may nevertheless be useful but that it can be complemented with additional analyses. Such an analysis, called profile analysis, is proposed and applied to the reading data of…