The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

The desire for students to graduate with more than basic skills has fueled interest in performance assessment methods such as essay writing, group science experiments, or portfolio preparation. Officials in Vermont, California, Kentucky, Maryland, and other states are betting that performance assessments may prove as powerful a classroom influence…

Restricted factor analysis shows that the multiple-choice and free-response sections of the Computer Science and Chemistry Advanced Placement examinations (College Board) measure the same proficiencies for the most part. There is a small degree of multidimensionality because of local dependence among free-response items. (SLD)

Presents evidence that conceptual and numerical multiple-choice questions effectively measure achievement in accounting courses for students with varying but basic English language skills, regardless of a student's native language. Well constructed multiple-choice questions are valid measuring devices for heterogeneous native-language groups.…

Two frame-of-reference rater training approaches were compared for effects on reliability and accuracy of cutoff scores generated by 21 raters using Angoff methods on tests taken by 155 undergraduates. Both approaches result in higher interrater reliability and more accuracy than does a non-frame-of-reference method. (SLD)

Methodology is suggested for several statistical procedures to detect polytomously scored items that function differently for two subgroups of examinees. The 3 methods are alternative ways of combining the data from 2 x "k" tables. Simulation results demonstrate the superiority of two of the methods, designated HW1 and HW3. (SLD)

Studies with 220 college students found that multiple-choice test items with 3 items are more difficult than those with 4 items, and items with the none-of-these option are more difficult than those without this option. Neither format manipulation affected item discrimination. Implications for test construction are discussed. (SLD)

Test taking and scoring are examined from the normative and descriptive perspectives of judgment and decision theory. The number-right scoring rule is endorsed because it discourages omissions and is robust against variability in respondent motivations, item vagaries, and limitations in judgments of uncertainty. (SLD)

Exploratory and confirmatory factor analyses were used to explore relationships among existing item types and three new computer-administered item types for the analytical scale of the Graduate Record Examination General Test. Results with 349 students indicate constructs the item types are measuring. (SLD)

Scores from mathematics (tested at 102 schools) and science (tested at 99 schools) sections of pilot forms of the Michigan High School Proficiency Test were examined for interaction between gender and response format (multiple choice or constructed response). Overall, neither males nor females seemed to be disadvantaged by item format. (SLD)

The shift from multiple-choice testing to performance assessment has brought a subtle shift in measurement philosophy. Selecting assessment tasks based on inherent value complicates inferences from test scores to nontest situations. A measurement-driven reform strategy relying on performance assessments to drive curriculum and instruction seems…

The effect that mode of administration, computer versus paper and pencil, had on the performance of 120 middle school students on multiple choice and written test questions was studied. Results show that, for students accustomed to writing on computers, responses written on the computer were more successful. Implications for testing are discussed.…

Discusses the advantages and disadvantages of multiple-choice tests, steps in developing good questions, and common pitfalls. Argues that carefully constructed multiple-choice questions can assess a wide variety of skills including higher-order thinking skills. Suggests that creating a good multiple-choice test starts with a description of the…

Students from 38 colleges with high scores on an advanced placement examination essay and low scores on the multiple-choice portion were compared with students with the opposite pattern. The pattern was not related to college grades, but was related to other test performance. (SLD)

Reports on two studies of student teachers that investigated the effect of asking learners to answer questions when learning in a hypertext environment. Discusses effects on concept learning from three learning environments: no response or feedback, analysis using a multiple choice questionnaire, and rule generation by students. (Author/LRW)