An increasingly popular test format allows examinees to choose the items they will answer from among a larger set. When examinee choice is allowed fairness requires that the different test forms thus formed be equated for their possible differential difficulty. For this equating to be possible it is necessary to know how well examinees would have…

A 1992 study by R. Gershon found discrepancies when comparing the theoretical Rasch item characteristic curve with the average empirical curve for 1,304 vocabulary items administered to 7,711 students. When person-item mismatches were deleted (for any person-item interaction where the ability of the person was much higher or much lower than the…

The purpose of this study was to compare the scores of students who were allowed unlimited retakes of a multiple-choice test with the scores of students who were limited to only four retakes (five trials) of the same test. The tests were each made up of 20 randomly drawn questions from a large pool of questions about research methods. Three…

One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

The goal of teaching philosophy is to develop philosophically literate students and to ensure that students develop philosophical literacy by design and not by chance. Perhaps the best method for teaching philosophy to beginning students is the public model, in which the practice of defending positions in the public arena forces students to become…

The results of a small research project that studied the effect computer administration has on student performance for writing or essay tests are presented. The introduction of computer-administered tests has raised concern about the equivalence of scores generated by computer versus paper-and-pencil test versions. For this study a sample of…

The research project reported in this paper had two aims: to demonstrate what standard multiple-choice questions and two new varieties (multiple-choice cloze and guided summary test and to assess whether the new formats test the same skills. To find out what the various question formats test, the study looked at a battery of tests, each of which…

An alternative to multiple-choice testing is suggested for educational assessment. The use of what is called "multiple-rating items" is proposed. A multiple-rating item calls for the examinee to rate all of a set of things instead of picking one as with a multiple-choice item. The respondent has to provide a specific rating of each…

This study explored the use of multiple-choice item formats and performance formats for assessment of learning science at the second grade level. It was completed during a 2-week unit entitled "Living Systems" that addressed Virginia Standards of Learning for second grade science. A 7-day unit was designed and both multiple-choice and…

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

Practical and effective methods for detecting copying of multiple-choice test responses have been available for many years. These methods have been used routinely by large admissions and licensing testing programs. However, these methods are seldom applied in the areas of standardized or classroom testing in schools or colleges, and knowledge…

This report describes a methodology for increasing the validity and reliability of inferences made about the problem-solving ability of science students that is based on performance on different kinds of tests. The generalizable cognitive components of problem solving that might be targeted by assessment are described, and specifications are…

From primary grades, students are exposed to both standardized and classroom tests. While teacher-made classroom tests may contain multiple choice, constructed response, or essay items, standardized tests, on the other hand, primarily rely on the multiple-choice format. Standardized tests are easy and inexpensive to administer and score, amenable…

In an exploration of customizing the Major Field Achievement Test in Political Science (MFATPS), developed by the Educational Testing Service, a questionnaire was sent to the heads of political science and joint departments which offer a bachelor's degree in Political Science. A total of 1,017 departments were surveyed in January 1990; 293…

Authentic measurement has become an important topic recently in educational testing. Advocates of authentic measurement feel that objective tests, multiple-choice tests in particular, cannot meet the demands required of today's tests and should be replaced by tests that can be closely matched to instruction and can assess higher-order cognitive…