Reviews some notions that have influenced the generation of comprehension questions, and describes a study that compared the knowledge sources third-grade students drew upon in answering text questions with the assumptions underlying the question hierarchies represented. (HOD)

No population exists where it is more important to produce information literate individuals than teacher candidates, yet few would suggest that practitioners newly entering the field are adequately prepared to model and teach information literacy to their students. Consequently, information literacy has recently been established as a key outcome…

In the school year 2000-2001 students in Grade 10 took the Graduation Exit Examination for the 21st Century (GEE 21) Language Arts and Mathematics tests for the first time. For GEE 21, student scores are reported in terms of five achievement levels: Advanced, Proficient, Basic, Approaching Basic, and Unsatisfactory. This booklet is part of a…

In this paper we draw on data from a large mathematics competition, for the years 1987 to 2000 and use two different but closely related measures to investigate possible gender differences in performance. Our analyses revealed that small gender differences in favour of males persisted but had decreased over time. Consistent with reports from…

This paper provides a historical review of the changes and improvements made in estimating numerical cutpoints for the National Assessment of Educational Progress (NAEP). While reviewing the various methodologies used for collecting judgment data, the paper discusses: (1) the incorporation of Item Response Theory for setting standards; (2)…

This study examined the SAT® II: Writing Subject Test as a predictor of writing performance in college English courses. Writing performance was based on eight writing samples submitted as part of regular course work by students in eight colleges. The samples consisted of drafts and final papers submitted in response to four take-home writing…

Over 2,000 writing samples were collected from four undergraduate institutions and compared, where possible, with scores on a multiple-choice test. High correlations between ratings of the writing samples and multiple-choice test scores were obtained. Samples contributed substantially to the prediction of both college grades and writing…

Presents the results of an investigation to determine if the position of a distractor in a multiple choice question influences the degree of difficulty of an item. The data support the hypothesis that the placement of the distractor immediately before the key alters the difficulty of the item significantly. (Authors/SA)

The California Commission on Teacher Credentialing's new program standards call for improved assessments of administrative performance. A wide range of traditional and nontraditional assessment approaches are being developed, including interviews, multiple-choice examinations, written or constructed responses, performance objectives and…

Despite educators' well-founded misgivings about standardized multiple-choice testing, this practice is firmly entrenched in American life. One of educators' major responsibilities is preparing students to make wise choices in school and the "real world." With college and career opportunities hinging on standardized test scores, schools are…

Mail questionnaire items that are susceptible to order effects were examined using data from 168 questionnaires in a Florida Cooperative Extension Service evaluation. Order effects were found for multiple-response and attributive questions but not for single-response items. Order also interacted with question complexity, social desirability, and…

A study of 26 college seniors used introspective and retrospective interviewing to assess cognitive processes used during multiple-choice reading comprehension tests. Categories of processing identified included an overall approach to the test task, reading strategies, and test-taking strategies. (TJH)

Several multiple-choice item formats are examined in the current climate of test reform. The reform movement is discussed as it affects use of the following formats: (1) complex multiple-choice; (2) alternate choice; (3) true-false; (4) multiple true-false; and (5) the context dependent item set. (SLD)

Describes recent efforts of the Center for Research in Evaluation, Standards and Student Testing (CRESST) to evaluate authentic assessment methods, such as portfolios and performance tests. When comparing the merits of authentic versus multiple-choice testing, it is wise to consider validity, reliability, consequences, fairness, generalization,…

Presents a study of the effect of question order on student performance on economics tests. Reports that question order has no statistically significant effect on examination scores, even after including variables that reflect differential human capital characteristics. Concludes that instructors need not worry that some examination versions give…