Many educational testing programs report examinee performance at more than two levels of proficiency. Whether these assessments have the capacity to support these multiple inferences, though, is a topic that has not been widely discussed. This study proposes a method for evaluating the minimum number of measurement opportunities for reporting…

This article presents findings from two projects designed to improve evaluations of technical quality of alternate assessments for students with the most significant cognitive disabilities. We argue that assessment technical documents should allow for the evaluation of the construct validity of the alternate assessments following the traditions of…

In most large-scale assessments of student achievement, several broad content domains are tested. Because more items are needed to cover the content domains than can be presented in the limited testing time to each individual student, multiple test forms or booklets are utilized to distribute the items to the students. The construction of an…

There are many threats to validity in high-stakes achievement testing. One major threat is construct-irrelevant variance (CIV). This article defines CIV in the context of the contemporary, unitary view of validity and presents logical arguments, hypotheses, and documentation for a variety of CIV sources that commonly threaten interpretations of…

Discusses three common misconceptions about achievement testing: (1) the idea that men generally outscore women; (2) the notion that the primary role of norms is to compare one student to another; and (3) the misconception that it is not possible to measure the achievement of kindergarten and primary grade students with group tests. (SLD)

This module describes some common standard-setting procedures used to derive performance levels for achievement tests in education, licensure, and certification. Upon completing the module, readers will be able to: describe what standard setting is; understand why standard setting is necessary; recognize some of the purposes of standard setting;…

The relationships between ratings on the Idaho Alternate Assessment (IAA) for 116 students with significant disabilities and corresponding ratings for the same students on two norm-referenced teacher rating scales were examined to gain evidence about the validity of resulting IAA scores. To contextualize these findings, another group of 54…

The development of a hypothetical testing program designed to provide optimum information about student achievement is chronicled. Computer adaptive testing and performance testing are postulated as part of the program. What optimum information really means is discussed. Optimum is only optimal when theory and application are balanced. (SLD)

The role of testing in determining college admissions and the impact of that testing on high school students are commanding increasing attention. There is emerging evidence that admissions decisions made solely on the basis of high school record can serve the college as well or better than decisions based, at least in part, on scores obtained on…