Highlights some of the major questions facing the measurement community in deciding how to conceptualize validity in the revised "Standards for Educational and Psychological Testing" of the American Association for Educational Research, the American Psychological Association, and the National Council on Measurement in Education. Focuses…

Comprehensive academic achievement tests are routinely used by school psychologists in psycho-educational assessment batteries to identify learning disabled students. A variety of assessment measures are used across age groups to determine if a discrepancy exists between academic achievement and intellectual functioning; however, among the most…

States and other educational entities receiving Part B funding under the Individuals with Disabilities Education Act (IDEA) submitted their Annual Performance Reports (APRs) and Section 618 Table 6 data together to the U.S. Secretary of Education on or before February 1, 2009. These reports may have been modified during the following few months,…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

A component of a school assessment plan includes traditional IQ testing, often referred to as psychological or psycho-educational testing. Psycho-educational testing can yield information about how a student compares to others in her grade or age group, individual strengths and needs, and recommendations to improve instruction. The intended…

This report provides an overview of the Milwaukee Parental Choice Program and the author's plan for evaluating it over a five year period. It also presents a brief summary of the main findings of the four distinct topical reports that the author and his colleagues have completed for 2006-07--the baseline year of the evaluation. Those four…

ACT is often asked whether student scores on the ACT[R] test can be used to make "norm-referenced" or "standards-referenced" comparisons. Norm-referenced interpretations compare students to one another, while standards-referenced interpretations measure student performance against predefined content standards. This brief shows…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Beyond some contracted minimum, salaried workers' hours are largely chosen at the worker's discretion and should respond to the strength of contract incentives. Accordingly, we consider the response of teacher hours to accountability and school choice laws introduced in US public schools over the past two decades. Total weekly hours of full-time…

It is essential for all students to be ready for college and career when they graduate from high school. Postsecondary educators expect high school graduates to be prepared academically for success in postsecondary education, which in turn influences success in the work world. Employers continue to call for workers to have the tools needed to…

This article is a description of the process of constructing an assessment of written and oral language for pre-service teachers. This assessment was used prior to their formal admission into the teacher education programme. The rationale for this evaluation is presented along with the actual processes involved. Finally, comparisons are made…

Evidence-centered assessment design (ECD) provides language, concepts, and knowledge representations for designing and delivering educational assessments, all organized around the evidentiary argument an assessment is meant to embody. This article describes ECD in terms of layers for analyzing domains, laying out arguments, creating schemas for…

Validity is a critically important issue with far-reaching implications for testing. The history of conceptualizations of validity over the past 50 years is reviewed, and 3 important areas of controversy are examined. First, the question of whether the three traditionally recognized types of validity should be integrated as a unitary entity of…

This paper describes three investigations conducted by the University of London School Examinations Department into the possible use of stimulus questions, containing original historical material such as cartoons, maps, photographs and statistics, in the 'O' level history examination. (Author)