Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high-stakes testing arena rely on classical test theory…

In practice, vertical scales have been continually used to measure students' achievement progress across several grade levels and have been considered very challenging psychometric procedures. Recently, such practices have been drawing many criticisms. The major criticisms focus on dimensionality and construct equivalence of the latent trait or…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…

This report examines the availability and quality of predictive validity data for a selection of benchmark assessments identified by state and district personnel as in use within Mid-Atlantic Region jurisdictions. Based on a review of practices within the school districts in the region, this report details the benchmark assessments being used, in…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

This article provides a brief primer overview of Differential Item Functioning (DIF) analysis. DIF analysis investigates a differential characteristic of a test item between subpopulations of examinees and is useful in detecting possibly biased items toward a particular subpopulation. As demonstration, a dataset from a 40-item math test in a…

This article presents the viewpoint that care must be taken to fit the specifics of a testing program to its intended purpose. Testing for diagnosing individual student learning and for school evaluation should not be confused. Statewide testing programs may provide evaluative information, but are inadequate sources of diagnostic information. (LMO)

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

Implications of using alternative assessments for accountability in a high-stakes testing environment (using tests to make impact decisions for students, schools, or teachers) are examined. The psychometric properties of standardized alternative assessments are discussed, and the consequences of their use are considered. (SLD)

A teacher's manual for operating the DX System, a software package for use in diagnostic testing programs, is presented. The DX System is constructed to present test items based on the individual student's pattern of responses. Described are: (1) system components designed to run on an Apple II computer; (2) program options allowing the user to…

This bibliography provides abstracts of 28 recent (most were published since 1993) books, journal articles, and other documents concerned with testing accommodations for students with disabilities. The emphasis was on studies examining the effects of testing accommodations on the technical integrity of assessment measures. However, the…

Traditional standardized tests of basic skills are no longer considered meaningful by many leading authorities in educational measurement. Alternative approaches are not yet fully developed, although many efforts are being made. This paper explores the issues surrounding student assessment in the context of existing and evolving state practices,…

Reflections on the proposal for creation and implementation of a national test are presented from the perspective of a test author. The most readily identified characteristic of the proposed national test is the intensity of debate surrounding it. Another easily identified characteristic is the anticipated effect. While proponents expect higher…

The psychological-educational test program that is used at Harcum Junior College in Bryn Mawr, Pennsylvania is discussed. The program assists students individually and in groups to assume responsibility for making their own educational and vocational career decisions. Student and class profiles from 1962 to 1970 which include I.Q. average, verbal…