Despite agreement about the central importance of validity for educational and psychological testing, consensus regarding the definition of validity remains elusive. Differences in the definition of validity are examined and reveals that a potential cause of disagreement stems from differences in word use and meanings given to key terms commonly…

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

There is no agreement at present about the importance or meaning of the term "consequential validity." It is important that the authors of revisions to the "Standards for Educational and Psychological Testing" recognize the debate and relegate discussion of consequences to a context separate from the discussion of validity.…

The psychometric literature is replete with comprehensive discussions of test validity, test validation, and the characteristics of quality assessment programs. The most authoritative source for guidance regarding sound test development and evaluation practices is the Standards for Educational and Psychological Testing. However, the Standards are…

The concept of consequential validity wrongly links the idea of the consequences of test use with the idea of validity, widely held to be rooted in the accuracy of inferences drawn from examinees' test performances. The reification of consequential validity can distract from a needed clarity about test use consequences. (SLD)

The relationships between ratings on the Idaho Alternate Assessment (IAA) for 116 students with significant disabilities and corresponding ratings for the same students on two norm-referenced teacher rating scales were examined to gain evidence about the validity of resulting IAA scores. To contextualize these findings, another group of 54…

It is argued that consequences are a logical part of the evaluation of test use, which has been an accepted part of test validity for several decades. The examination of effects following from test use is essential in evaluating test validity and not merely the domain of policymakers and politicians. (SLD)

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

The findings in Volume I of the Committee on Ability Testing's report (see ED 213 770 and ED 213 771) are shown to be ambiguous regarding the meaning of ability, vague regarding test validity, and ingenuous regarding test uses and misuse. The neglect of the basic question of what tests measure is noted. (CM)

The gap between professionally and legally acceptable practice in professional licensure tests is addressed. Pertinent activities of the American Psychological Association, American Educational Research Association, and the National Council for Measurement in Education are discussed. (TJH)

The author argues that scoring, reporting, and deriving final grades can be considerably assisted by using a computer. He also contends that the savings in time and the computer database formed will allow instructors to determine test quality and reflect on the quality of instruction. (BW)

This synopsis of the Committee on Ability Testing report (see ED 213 770 and ED 213 771) discusses recent controversy over testing limitations, test fairness, admissions testing, test disclosure, and test use in public schools to improve substandard performance. (CM)

Discrepancies between court and professional association views of licensing examinations are discussed. Litigation associated with Title VII of the Civil Rights Act of 1964 and constitutional law is considered. Courts should examine professional standards and apply those that are consistent with the court's determination of the proper…