This article offers a critique of the validity argument put forward by Camara, Mattern, Croft, and Vispoel (2019) regarding the use of college-admissions tests in high school assessment systems. We challenge their argument in two main ways. First, we illustrate why their argument fails to address broader issues related to consequences of using…

This rejoinder provides a reply to comments on a middle school college readiness index, which was devised to generate earlier and more nuanced readiness diagnoses to K-12 students. Issues of reliability and validity (including construct underrepresentation and construct-irrelevant variance) are discussed in detail. In addition, comments from…

In an article published in "Educational Measurement: Issues and Practice," Gaertner and McClarty (2015) discuss a college readiness index based, in part, on nonacademic or noncognitive factors measured in middle school. Such an index is laudable as it incorporates important constructs beyond academic achievement measures that may be…

The main points of Sijtsma and Green and Yang in Educational Measurement: Issues and Practice (34, 4) are that reliability, internal consistency, and unidimensionality are distinct and that Cronbach's alpha may be problematic. Neither of these assertions are at odds with Davenport, Davison, Liou, and Love in the same issue. However, many authors…

Six distinguishable aspects of construct validity are discussed as they apply to performance assessment, emphasizing content, substantive, structural, generalizability, external, and consequential aspects. Taken together, these aspects provide a way to address validity questions in score interpretation and use. (SLD)

This reply to William A. Mehrens argues that test validity is the central issue in discussing the appropriate role of tests. It states that the procedures used to establish the validity of tests are inadequate because they depend primarily on content validity and not on construct and criterion validity. (JAZ)

In response to Ebel (TM 508 146) Gardner argues that neither intrinsic rational validity associated with ability tests nor a validity coefficient relating a test to performance as the sole information about validity is sufficient. All relevant data about a test and its functioning are essential in describing the validity of the test. (Author/LC)

Obtaining the intrinsic rational validity Ebel describes (TM 508 146) requires several steps that have been neglected in developing tests of ability. These include defining and describing the behaviors that demonstrate possession or lack of the ability, analyzing behaviors, translating the analyses into specifications for test items, and writing…

In many school districts, the pressure to raise test scores has created overnight celebrity status for formative assessment. Its powers to raise student achievement have been touted, however, without attending to the research on which these claims were based. Sociocultural learning theory provides theoretical grounding for understanding how…

There is no agreement at present about the importance or meaning of the term "consequential validity." It is important that the authors of revisions to the "Standards for Educational and Psychological Testing" recognize the debate and relegate discussion of consequences to a context separate from the discussion of validity.…

In the Spring 2005 issue, Wang, Schnipke, and Witt provided an informative description of the task inventory approach that centered on four functions of job analysis. The discussion included persuasive arguments for making systematic connections between tasks and KSAs. But several other facets of the discussion were much less persuasive. This…

The validity of high-stakes assessments and accountability systems is discussed in relation to the requirements of No Child Left Behind (NCLB). The extent to which content standards and assessments are cognitively rich, the challenges in setting performance standards, and the impact of high-stakes assessments on instruction and student learning…

In response to Ebel's article (TM 508 146) the author points out that, in emphasizing what a test is intended to measure, the vital question of what should be measured is set aside. While explicit specifications for a test should be encouraged, questions of worth ought to be prominent in designing and selecting tests. (Author/LC)

Instructional validity indicates that a district is testing what is taught. Minimum standards of fairness in pursuing educational equity are proposed. The standards include efforts to remediate students who fail competency tests, use instructional validity studies; present an adequate opportunity to learn, make an appropriate use of results, and…

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)