We describe an innovative automated test construction algorithm for building aligned achievement tests. By incorporating the algorithm into the test construction process, along with other test construction procedures for building reliable and unbiased assessments, the result is much more valid tests than result from current test construction…

Lissitz and Samuelsen (2007) argue that the unitary conception of validity for educational assessments is too broad to guide applied work. They call for attention to considerations and procedures that focus on "test development and analysis of the test itself" and propose that those activities be collectively termed "content validity." The author…

This article raises a number of questions about the current unified theory of test validity that has construct validity at its center. The authors suggest a different way of conceptualizing the problem of establishing validity by considering whether the focus of the investigation of a test is internal to the test itself or focuses on constructs…

Discusses issues involved in the construction, validity, and use of tests that evaluate educational progress, especially those that assess higher-order cognitive functioning. Reviews the four articles in this special issue. (FMW)

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

In response to Lissitz and Samuelsen (2007), the author reconstructs the historical arguments for the more comprehensive unitary concept of validity and the principles of scientific inquiry underlying it. Her response is organized in terms of four questions: (a) How did validity in educational measurement come to be conceptualized as unitary, and…

Lissitz and Samuelsen (2007) propose a new framework for validity theory and terminology, emphasizing a shift in theory and practice toward issues of test content rather than constructs. The author of this article argues that several of Lissitz and Samuelsen's critiques of validity theory focus on previously considered, but subsequently discarded,…

Carefully collected, quantifiable evidence must be assembled regarding not only the content representativeness of a test but also the significance of that content. In addition, the concept of "adequacy of preparation" should be seen as separate from the issue of content validity. (Author/GC)

Responds to letters to the editor regarding comments on semantics, psychometrics, and assessment reform regarding authentic assessment of student academic achievements. Suggests that psychometric concerns need to be addressed. (MMU)

Because of the importance of standardized test scores in current definitions of educational achievement, pressure to raise test scores has affected their accuracy. Examines the causes of two major sources of test score pollution and their impact on education. Discusses the ethical status of documented test-preparation activities. (CJS)

Proposes a systemically valid testing system that induces curricular and instructional changes in education systems to foster the development of the cognitive traits that tests are designed to measure. Analyzes test characteristics and outlines the principles of a systemically valid testing system. (FMW)

Discusses authentic assessment of student performance as it relates to academic improvement and educational reform. Points out that there is too much testing of basic knowledge and skills out of context, and too little teaching of complex concepts. (MMU)

Examines, in a qualitative study, the role of mandated tests on elementary schools, describing in particular their emotional impact on teachers, who may suffer sanctions or loss of autonomy based on low test scores. Describes some of the curricular and methodological effects of standardized testing. (CJS)

Investigates the validity and reliability of performance assessments using data from over 300 fifth and sixth graders. Results demonstrate the gap between the reality of measurement through performance assessments and the political rhetoric that would institute these assessments in a national examination system in the immediate future. (SLD)

Discusses the movement toward authentic assessment, also called direct or performance assessment, as an alternative to multiple-choice, standardized, norm-referenced testing. Authentic testing involves assessment tasks that are real instances of extended criterion performances rather than proxies of actual learning goals. Questions use of…