A course with good learning outcomes is one in which most of the enrolled students achieve the mastery specified in the predefined learning objectives. Since the enrolment is invariably a mix of students with heterogeneous capabilities, the class average grade is a poor indicator of how the class is divided into at least two groups, of high- and…

Low motivation to perform well on a test is a potentially problematic source of construct-irrelevant variance (Messick, 1980), especially when there are low or no stakes attached to performance. That is, interpretations of test scores as indicators of students' knowledge and skills may be compromised if those students do not put forth the effort…

A recent NBER [National Bureau of Economic Research] working paper examines Florida's policy to retain many low-scoring third graders. The report concludes that third-grade retention has immediate positive effects on the following year's test results, but these effects fade over the next six years, with no effect on graduation. The regression…

The study analyzed 2005 posttest data compared to 2008 posttest data to determine student end of school year academic achievement outcomes across three academic levels (above average, average, and below average chemistry potential) and two teacher homework evaluation methods (assigned but not graded and assigned and graded) on teacher prepared…

An evolved form of the Edwards and Beckworth (1989) model for probability selection for Scholastic Achievement Test takers using truncated normal distributions is presented. It is shown that the arguments of Holland and Wainer are not sufficient to reject this model. (SLD)

This study introduces procedures for constructing a proficiency scale for a large-scale test by applying Tatsuoka's Rule Space Model. The SAT Mathematics (SAT M) Section 2 is used for illustrating the process and the results. A task analysis is summarized in a mapping sentence, and then 14 processes and content attributes are identified for…

A scaling procedure is proposed, based on item response theory (IRT), to fit non-hierarchical test structure as well. The binary scores of a test of English were used for calculating the probabilities of answering each item correctly. The probability matrix was factor analyzed, and the difficulty intervals or estimates corresponding to the factors…

As part of the military recruiting effort, the Department of Defense sponsors surveys of the national youth population to help design recruiting and advertising strategies. This report develops and applies a method of using the information contained in national youth surveys to estimate the probability that respondents taking the Armed Forces…

This chapter should not only acquaint the reader with the present state of the art on Criterion-Referenced (CR) measurement but also suggest possible directions for further inquiry. The goal of the first part of this chapter is to deal with the definitional dilemma of CR measurement by proceeding from the more traditional view of CR measurement to…