This focus article provided the author with an opportunity to unpack the consensus definition of validity and to explore its implications in the light of recent debates. He proposed an elaboration of the consensus definition, which was intended to express the spirit of the "Standards for Educational and Psychological Testing" with increased…

Many individuals who attempt to enter teacher education programs are precluded from doing so because of an inability to pass basic skills tests. The authors examine whether these tests are simply a gate that needs to be passed through or whether they provide useful early information about how individuals are likely to perform on subsequent…

This article describes the 2009 revision of the Dutch Rating System for Test Quality and presents the results of test ratings from almost 30 years. The rating system evaluates the quality of a test on seven criteria: theoretical basis, quality of the testing materials, comprehensiveness of the manual, norms, reliability, construct validity, and…

The authors investigated the extent to which taking specific types of Advanced Placement (AP) courses and the number of courses taken predicts the likelihood of passing subject benchmarks and earning a score of 19 on the composite score on the ACT test, and examined the role gender plays in the projection. They found evidence that taking an AP…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

This paper will describe the relationships between research on learning and its application in assessment models and operational systems. These have been topics of research at the National Center for Research on Evaluation, Standards, and Student Testing (CRESST) for more than 20 years and form a significant part of the intellectual foundation of…

There is a growing body of literature linking curriculum based measurements and general outcome measures to state test outcomes. With an increasing focus on the early identification of students at risk for academic failure, the present study investigated the predictive validity of preschool early literacy general outcome measures (GOMs) in a low…

The purpose of this study was to examine the reliability, validity, and predictive utility of 3 measures for screening kindergarten students for risk for math difficulty (MD). The screening measures assessed number sense and computational fluency, constructs central to typical early mathematical development. Conceptual and operational outcomes…

The use of microworlds (MWs), or complex dynamic systems, in educational testing and personnel selection is hampered by systematic measurement errors because these new and innovative item formats are not adequately controlled for their difficulty. This empirical study introduces a way to operationalize an MW's difficulty and demonstrates the…

Many districts and schools across the U. S. have begun to develop and administer assessments to complement state testing systems and provide additional information to monitor curriculum, instruction and schools. In advance of this trend, the Jackson Public Schools (JPS) district has had a district benchmark testing system in place for many years.…

This paper updates the concept of test validity. This new conception entails a set of 10 categories combined together in pairs: curriculum and instructional validity, statutory and forensic validity, media and journalistic validity, political and legislative validity, and partisan and activist validity. (Author/DWH)

A longitudinal evaluation of the utility of a screening battery administered in kindergarten is shown to retain a high utility for predicting current achievement outcomes of the sample at the end of grade six. The use of discriminant functional analysis and statistical decision theory is discussed. (Author/CM)

Responds to the Nader report on the Educational Testing Service authored by Nairn. Major themes of the nine chapters of the report are addressed. The last sections provide comment on the responses of the Educational Testing Service. (RC)

The purpose of this study was to develop a screening procedure for undergraduate pilot training (UPT). This procedure was based upon the use of ground-based instrument trainers in which UPT candidates, naive to flying, were evaluated in their performance of job sample tasks; i.e., basic instrument flying. Training and testing sessions were…