We conducted 2 studies to investigate undergraduate performance, perceptions, and time required in completing sequentially ordered, randomly ordered, or reverse ordered exams in introductory psychology classes. Study 1 compared the outcomes and perceptions of students (N = 66) on 3 non-comprehensive multiple-choice exams which were sequentially,…

Students in an undergraduate human development course (N = 215) participated in a brief assessment of their reading (comprehension level, reading speed, comprehension rate) and multiple-choice test-taking skills on the second day of class. Students first read a one-page, 400-word passage unrelated to the course and then answered 10…

Some educational contexts almost mandate the application of multiple-choice (MC) testing techniques, even if they are deplored by many practitioners in the field. In such contexts especially, research into how well these types of item perform and how their performance may be characterised is both appropriate and desirable. The focus of this paper…

This study describes the reading and test-taking strategies that test takers used on the "Reading" section of the "LanguEdge Courseware" (2002) materials developed to familiarize prospective respondents with the new TOEFL. The investigation focused on strategies used to respond to more traditional "single selection"…

This study examines how passage availability and reading comprehension question format (open-ended vs. multiple-choice) influence question answering. In two experiments, college undergraduates read an expository passage and answered open-ended and multiple-choice versions of text-based, local, and global bridging inference questions. Half the…

Background: Quality mental health care for adults with an intellectual disability (ID) depends upon the availability of appropriately trained and experienced psychiatrists. There have been few surveys of psychiatrists working with this population. Method: This Australian study obtained psychiatrists' attitudes to and perceptions of the mental…

Despite the prevalence of multiple choice items in educational testing, there is a dearth of empirical evidence for multiple choice item writing rules. The purpose of this study was to expand the base of empirical evidence by examining the use of the "all-of-the-above" option in a multiple choice examination in order to assess how…

Do students change as a result of completing their general education requirement? This question was examined by using a pretest/posttest design with five different cohorts of students required to complete a general education program in American history and politics. Differences among various groups in Cohen's d (the standardized difference between…

This research concerns the development and assessment of a program of introductory astronomy conceptual exercises called ranking tasks. These exercises were designed based on results from science education research, learning theory, and classroom pilot studies. The investigation involved a single-group repeated measures experiment across eight key…

The study evaluated the comparability of two versions of a certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). An effect size measure known as Cohen's d and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that the effect…

In U.S. schools, students must pass statewide competency tests to graduate from high school. In this article, the authors summarize the development and testing of a program implemented to improve the skills of students failing to "make the grade" on these high-stakes tests. District personnel randomly assigned twenty-eight students who…

In traditional Chinese medicine, a key maxim is "Zhi Bing Yao Zhi Gen," which literally means, "To cure a disease one must cure the underlying cause." The author was reminded of this principle when she reflects on K-12 math education reform when the US. President Bush's 2006 State of the Union Address prompted yet another wave…

This dissertation sought to answer the question: Is it possible to build a software tool that will allow teachers to write better multiple-choice questions? The thesis proceeded from the finding that the quality of teaching is very influential in the amount that students learn. A basic premise of this research, then, is that improving teachers…

The purpose of this study was to document the instrument development of maze measures for grades 3-8. Each maze passage contained twelve omitted words that students filled in by choosing the best-fit word from among the provided options. In this technical report, we describe the process of creating, reviewing, and pilot testing the maze measures.…

Twenty-four students who scored 650 or more on the Scholastic Aptitude Test Mathematics test (SAT-M) were asked to think aloud while solving 13 mathematics items in either multiple-choice or free-response format. Strategies students used to solve the items were classified as either algorithmic or insightful. Data analyses indicated that items in…