Two item-writing rules were tested: phrasing stems as questions versus partial sentences; and using the "none-of-the-above" option instead of a specific content option. Results with 228 college students do not support the use of either stem type and provide limited evidence to caution against the "none-of-the-above" option.…

Discusses a concurrent validity study of an indirect measure of English-as-a-Second-Language writing based on information processing: anagram solving, word reordering, paragraph assembly tests, etc. The criterion measure was a direct, holistic measure of writing. Analysis revealed that the indirect measure did not exhibit concurrent validity for…

A "successful intelligence" intervention improved school achievement for a group of 225 ethnically diverse third-graders, both on performance assessments measuring analytical, creative, and practical achievements and on conventional multiple-choice memory assessments. Teaching for triarchic thinking facilitates factual recall, because learning…

A Rasch-type analysis is presented for multiple-choice items in which one parameter is assigned to each distractor. Results of a small simulation study show that the parameter recovery of the distractor model is very satisfactory. Analysis of a real dataset shows that some items fit the Rasch model rather than the distractor model. (SLD)

Multiple-choice and true-false versions of Palmore's first Facts on Aging Quiz were completed by 501 college students. Multiple choice reduced the chances of guessing and had less measurement error for average and above-average respondents. (Author/SK)

Multiple choice questions are a common method of assessing student understanding. In this article, the authors discuss and evaluate a student-focused collaborative learning strategy for working with such questions that results in greater student learning and allows instructors to better understand student thinking and ultimately to write better…

Four item response theory linking methods (2 moment methods and 2 characteristic curve methods) were compared to concurrent (CO) calibration with the focus on the degree of robustness to format effects (FEs) when applying the methods to multidimensional data that reflected the FEs associated with mixed-format tests. Based on the quantification of…

In this article we describe the development, analysis, and interpretation of a novel item format we call Ordered Multiple-Choice (OMC). A unique feature of OMC items is that they are linked to a model of student cognitive development for the construct being measured. Each of the possible answer choices in an OMC item is linked to developmental…

Purpose: To provide educationalists with an understanding of the key quality issues relating to multiple-choice tests, and a set of guidelines for the quality assurance of such tests. Design/methodology/approach: The discussion of quality issues is structured to reflect the order in which those issues naturally arise. It covers the design of…

Students (N=153) in three equivalent sections of an undergraduate human development course compared pairs of related concepts via either written or oral discussion at the beginning of most class sessions. A writing-for-random-credit section achieved significantly higher ratings on the writing activities than did a writing-for-no-credit section.…

This handbook is intended to help high school and college counselors effectively use and interpret ACT results. It contains four main sections: Section 1, "Components of the ACT," which contains general information about the ACT tests, probably will be of interest both to high school counselors and to college advisors and other staff. …

Judge-mediated examinations are defined as those for which expert evaluation (using rubrics) is required to determine correctness, completeness, and reasonability of test-taker responses. The use of multifaceted Rasch modeling has led to improvements in the reliability of scoring such examinations. The establishment of criterion-referenced…

In an examination of the effects of timing of feedback on student learning, participants were randomly assigned to complete five introductory course tests using either control (Scantron form) or one of three feedback (end-of-test, 24-hr delay, immediate) procedures. A cumulative final examination with 50 new items and 10 items repeated from each…

The aim of this study was to investigate the effectiveness of instruction supplemented by conceptual change texts (CCTs) over traditional instruction on students' understanding of electrochemical (galvanic and electrolytic) cell concepts. The participants of the study consisted of 64 students from the two classes of a high school located in…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics statistics are typically provided by a measurement, or test scoring, service, where tests are machine-scored or by testing software packages. Test makers can capitalize on the fact that "bad" items can be differentiated from…