A problem faced by many instructors is that of designing exams that accurately assess the abilities of the students. Typically, these exams are prepared several days in advance, and generic question scores are used based on rough approximation of the question difficulty and length. For example, for a recent class taught by the author, there were…

A sample of 22 multiple-choice questions is provided to point up the potentialities of this type question, as well as to dispel the myth that "objective" tests require no thought, insight, or understanding. The questions have been taken from a variety of tests constructed by Educational Testing Service, and are presented as they appeared in the…

A single-administration classification reliability index is described that estimates the probability of consistently classifying examinees to mastery or nonmastery states as if those examinees had been tested with two alternate forms. The procedure is applicable to any test used for classification purposes, subdividing that test into two…

A decision-theoretic procedure is outlined which provides a framework within which Bayesian statistical methods can be employed with criterion-referenced tests to improve the quality of decision making in objectives based instructional programs. (Author/DEP)

Attainment tests in English and mathematics were administered to a total sample of 2,011/15-year old students. The English test consisted of a composition and a test battery of objective items. Marking of the composition was made by the test designer on a rapid first-impression reading. The objective test battery consisted of a comprehension test,…

Clues in the answers given to the Spanish Advanced Placement Examination questions can identify the test-taker as having learned the language in the classroom or as a native speaker. The Educational Testing Service has found mechanisms to ensure that the tests are equally suited to the two groups. (MSE)

In this paper, several models for the psychometric nature of criterion-referenced tests are presented and results derived with implications for test construction, reliability and validity measures, and educational decision making. Both dichotomous and continuous underlying abilities to perform are considered. Illustrative data fitting both cases…

The initial study was based on responses of 103 examinees on an objective classroom test. Results indicated that response changes increased item difficulties as well as biserial and point biserial correlations. Test reliability was not decreased. This implies that not all students benefit from changing initial responses. The personal biserial…

This book provides basic skills and knowledge about assessment so that teachers can expand their ability to deal with appraisal problems in their own settings. The first section deals with the basic principles of assessment. The second section concerns creating and applying assessment tools. The third section reviews issues in understanding and…