Reasonable and practical solutions to two major problems confronting the developer of any test of educational achievement (what to measure and how to measure it) are proposed, defended, and defined. (Author/PN)

A multiple true-false item is one where a testee has to identify statements as true or false within a cluster (of two or more) of such statements. Clusters are then scored as items. This study showed such a procedure to yield less reliable results than traditional true-false items. (JKS)

As achievement in basic reading declines, the content validity of tests in special subjects may be reduced because examinees cannot read the test items. This study found that reading ability and item format affected test scores in the area of health science for a sample of high school students. (Author/JKS)

Presents guidelines for constructing tests which accurately measure a student's cognitive skills and performance in a particular course. The advantages and disadvantages of two types of test items are listed (selected response and constructed response items). Both poor and good examples are given and general rules for test item writing are…

A study compared college students' performance on complex multiple-choice tests with scores on multiple true-false clusters. Researchers concluded that the multiple-choice tests did not accurately measure students' knowledge and that cueing and guessing led to grade inflation. (PP)

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

Traditional tests fall into two categories, both of which have several advantages and disadvantages that need to be considered when determining the type of test to use. Constructed-response tests, such as essay tests, ask students to construct their own responses. Thus, students are required not only to recall but to organize and often apply…

This paper clarifies important distinctions in item writing and item scoring and considers the implications of these distinctions for developing guidelines related to test construction for training teachers. The terminology used to describe and classify paper and pencil test questions frequently confuses two distinct features of questions:…

Several multiple-choice item formats are examined in the current climate of test reform. The reform movement is discussed as it affects use of the following formats: (1) complex multiple-choice; (2) alternate choice; (3) true-false; (4) multiple true-false; and (5) the context dependent item set. (SLD)

The psychometric properties of objective tests administered in two testing conditions were compared, using an experimental take-home testing condition and a traditional in-class testing condition. Subjects were 290 college students in a basic educational psychology course who took a test developed and tested the previous semester. Two equivalent…

The shortcomings of the conventional way of using and interpreting multiple-choice tests are summarized. Some theories and methodologies that can be applied for better use multiple-choice test items are described. Empirical facts are introduced to support the theoretical observations. New strategies are proposed that will reduce "noise"…

The Rasch model for test analysis is a latent-trait model, which specifies the relationship between observable test performance and the unobservable traits or abilities assumed under test performance. In most cases, the test constructor has no clue as to whether the latent traits postulated by the model are indeed the abilities he wants to…

The Microcomputer Diagnostic Testing Project (MDTP) was designed to broaden the use of microcomputers in student testing, for elementary and secondary school use, and for a variety of test item formats. MDTP was designed to administer tests, to allow teachers to create or revise tests, to print out test forms when desired, to score tests, to…

This book is a practical guide for assessing the intended learning outcomes of classroom instruction. It is based on the premise that assessment of student achievement plays a vital role in instruction and that the main goal of assessment is to improve learning. The new title of this sixth edition reflects a shift from major concern with classroom…

This individualized learning package on test item construction as a component of evaluation is designed for the undergraduate student in teacher education programs. The hierarchy of learning levels on which the package rests is that of B. Bloom's (1956) taxonomy of learning. The premises are that higher order learning is significant and desirable…