The study evaluated the comparability of two versions of a certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). An effect size measure known as Cohen's d and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that the effect…

In U.S. schools, students must pass statewide competency tests to graduate from high school. In this article, the authors summarize the development and testing of a program implemented to improve the skills of students failing to "make the grade" on these high-stakes tests. District personnel randomly assigned twenty-eight students who…

In traditional Chinese medicine, a key maxim is "Zhi Bing Yao Zhi Gen," which literally means, "To cure a disease one must cure the underlying cause." The author was reminded of this principle when she reflects on K-12 math education reform when the US. President Bush's 2006 State of the Union Address prompted yet another wave…

This dissertation sought to answer the question: Is it possible to build a software tool that will allow teachers to write better multiple-choice questions? The thesis proceeded from the finding that the quality of teaching is very influential in the amount that students learn. A basic premise of this research, then, is that improving teachers…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

Twenty-four students who scored 650 or more on the Scholastic Aptitude Test Mathematics test (SAT-M) were asked to think aloud while solving 13 mathematics items in either multiple-choice or free-response format. Strategies students used to solve the items were classified as either algorithmic or insightful. Data analyses indicated that items in…

The relationship between the multiple-choice and free-response sections of the Computer Science and Chemistry tests of the College Board's Advanced Placement program was studied. Confirmatory factor analysis showed that the free-response sections measure the same underlying proficiency as the multiple-choice sections for the most part. However,…

When running out of time on a multiple-choice test, some examinees are likely to respond rapidly to the remaining unanswered items in an attempt to get some items right by chance. Because these responses will tend to be incorrect, the presence of "rapid-guessing behavior" could cause these items to appear to be more difficult than they…

This paper describes a process used to assess the technical competency of non-direct line candidates for managerial positions in computer specialties. The Training and Experience (T&E) qualifying test, a multi-method approach combining task-based, computer scorable evaluations of training and experience with multiple-choice batteries, was used as…

Using multiple choice tests and a statistical method designed to identify flagrant cheaters, the authors undertook to determine (1) the magnitude of cheating on take-home and open-book exams; (2) whether the amount of cheating varied according to three types of examinations (closed-book, open-book or take-home); and (3) if cheating was affected by…

Some of the pitfalls in the construction of multiple choice tests are discussed and examples of invalid questions given. (RM)

Describes the development of multiple-choice test item bank for grade ten science by the Australian Council for Educational Research. Other item banks are also being developed at the grade ten level in mathematics and social science. (RH)

This study of survey research experts was conducted to determine desirable characteristics of mail questionnaires. The 82-item Likert-scale instrument used in the study covered general appearance, instructions, choice of items, choice of response options, wording, order of items, and item format. The instrument was administered to: 8 subjects who…

Research has shown that multiple-choice questions formed by transforming or paraphrasing a reading passage provide a measure of student comprehension. It is argued that similar transformation and paraphrasing of lesson questions is an appropriate way to form parallel multiple-choice items to be used as a posttest measure of student comprehension.…

This paper discusses the development and use of "item shells" in constructing multiple-choice tests. An item shell is a "hollow" item that contains the syntactic structure and context of an item without specific content. Item shells are empirically developed from successfully used items selected from an existing item pool. Use…