This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Extended time is one of the most common testing accommodations provided to students with disabilities. It is also controversial; critics of extended time accommodations argue that extended time is used too readily, without concern for how it changes the skills measured by tests, leading to scores that cannot be compared fairly with those of other…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…

This report examines the availability and quality of predictive validity data for a selection of benchmark assessments identified by state and district personnel as in use within Mid-Atlantic Region jurisdictions. Based on a review of practices within the school districts in the region, this report details the benchmark assessments being used, in…

Note that judgments about the relationship of test items to actual job duties have generally been made as a single comparison, proposes a model for analyzing the accuracy of translations for each step of the process of test development for use in personnel administration, and suggests scaling procedures appropriate for the various judgments. (JM)

The usefulness of traditional concepts of validity and reliability, developed for large-scale assessments, for the classroom context is explored. Alternate frameworks that situate these constructs in teachers' work in classrooms are presented, and their use in an assessment course for preservice teachers is described. (SLD)

This book summarizes the evaluation by the Committee on the General Aptitude Test Battery (GATB) of the National Research Council of the U.S. Employment Service's use of the GATB. The book serves professional users, policymakers, and students of psychometrics because of its clear and concise review of important issues. (SLD)

A critical review of the psychometric properties of the System of Multicultural Pluralistic Assessment (SOMPA) model for student assessment is presented. The review criticizes the lack of validity of some of the measures but praises the goals of the system. (JKS)

In the United States, tests are held to high standards of quality. In developing countries such as Malawi, psychometricians must deal with these same high standards as well as several additional pressures such as widespread cheating, test administration difficulties due to challenging landscapes and poor resources, difficulties in reliably scoring…

Tests in social studies and integrated science given in Saint Vincent, Saint Lucia, Grenada, and Dominica were analyzed by the Organization for Co-operation in Overseas Development (OCOD) Comprehensive Teacher Training Program (CTTP) for discrimination, difficulty, and reliability, as well as other characteristics. There were 767 examinees for the…

This study examined the curricular validity of the New Jersey Basic Skills test, a minimum competency test administered to all public school students in grades 3, 6, 9, and 11 to measure basic skills in reading and mathematics. Based on examinations of a Modified Caution Index, there were differences in the usual response patterns for both reading…

The psychometric properties of the testing tools of the Michigan Educational Assessment Program (MEAP), the state standardized testing program, are examined. Reliability studies have indicated that the scores from the MEAP, ranging from 0.654 to 0.949, are generally acceptable. The State Department of Education offered supporting evidence for the…

The North Carolina End-of-Grade Testing Program is based on the assessment of higher level skills in the context of specific subject-area content. These tests inform students, parents, the community, and educators about the achievement of North Carolina students in grades three through eight in given areas. This report describes the development…