The primary goal of this project was to examine the predictability of Scholastic Aptitude Test (SAT) reading item difficulty (equated delta) for main idea items, and the predictability of main idea, inference, and explicit statement item types. A secondary purpose was to contrast the responses of high verbal and low verbal ability examinees.…

Contrasts between constructed response items and stem-equivalent multiple-choice counterparts typically have involved averaging item characteristics, and this aggregation has masked differences in statistical properties at the item level. Moreover, even aggregated format differences have not been explained in terms of differential cognitive…

In order to evaluate the Test of English as a Foreign Language (TOEFL) vocabulary item format and to determine the effectiveness of alternative vocabulary test items, this study investigated the functioning of eight different multiple-choice formats that differed with regard to: (1) length and inference-generating quality of the stem; (2) the…

This study examined the relationship of a machine-scorable, constrained free-response computer science item that required the student to debug a faulty program to two other types of items: multiple-choice and free-response requiring production of a computer program. The free-response items were from the College Board's Advanced Placement Computer…

Current conceptions of literacy and what being literate means are discussed, and the strengths and weaknesses of the standardized multiple-choice test as a tool for assessing literacy proficiency and a way to report learning progress are explored. The possible advantages of alternative assessment strategies are reviewed, and an assessment model is…

To help increase the understanding of sources of difficulty in test items, a study was undertaken to evaluate the effects of various aspects of prose complexity on the difficulty of achievement test items. The items of interest were those that presented a verbal stimulus followed by a question about the stimulus and a standard set of…

This research summarizes differential item functioning (DIF) results for student produced response (SPR) items, a nonmultiple-choice mathematical item type in the Scholastic Aptitude Test I (SAT I). DIF data from 4 field trial pretest administrations (620 SPR items) and 10 final forms (100 SPR items with samples ranging from about 58,000 to over…

A study investigated the effect of a prereading strategy on the reading comprehension of foreign language students. Subjects were 62 French students in 5 classes at 3 suburban high schools. A rotation design was used within each class. A reading in the target language was assigned twice a week for two weeks. The treatment sample went through a…

A total of 149 students enrolled in an undergraduate nursing research methods course participated in a study comparing three strategies for using formative evaluation (test feedback throughout a course) to predict students at risk of failure at summative evaluation (the final examination). Students took 12 weekly multiple-choice quizzes, which…

This digest describes the organization of the National Assessment of Educational Progress (NAEP) and what is included in a typical NAEP assessment. The way in which the NAEP selects students for assessments and how the assessments are used are discussed. The NAEP is a congressionally mandated project of the National Center for Education…

A new method for estimating the parameters of the normal ogive three-parameter model for multiple-choice test items--the normalized direct (NDIR) procedure--is examined. The procedure is compared to a more commonly used estimation procedure, Lord's LOGIST, using computer simulations. The NDIR procedure uses the normalized (mid-percentile)…

The purpose of this study was to determine whether item difficulty is significantly affected by language difficulty and response set convergence. Language difficulty was varied by increasing sentence (stem) length, increasing syntactic complexity, and substituting uncommon words for more familiar terms in the item stem. Item wording ranged from…

This was a replicative study that was initiated with a journeyman level certification instrument for an international union, when industry monitors were observed suggesting to examinees to "go with your first response." The question arose whether this was a researched-based practice. If not, wouldn't this practice inject constant error…

A number of higher order cognitive skills are used in the task of evaluating arguments. Such skills should be assessed because the ability to evaluate arguments is an important one in all subject areas. In addition, it seems reasonable to assume that these evaluative skills will be representative of those required by other cognitively demanding…

The booklet presents the two-part Grade 12 Diploma Examination for the Social Studies 30 program. Part 1 consists of 70 multiple-choice questions worth 70% of the total score. Each question has four choices and students must choose the one which best completes the statement or answers the question. Many questions are based on narratives,…