This guide explains the concept of out-of-level testing and suggests a formula for estimating the occurrence of floor effects and ceiling effects, within the context of models for evaluating Elementary Secondary Education Act (ESEA) Title I programs. An analogy explains floor and ceiling effects as if test items are stored in different levels in a…

THE PUPIL PERSONNEL WORKERS SITUATIONAL BLANK (PPWSB) TESTED THE REACTIONS OF 46 COUNSELORS, NINE PSYCHOLOGISTS, 37 SOCIAL WORKERS, AND 52 NURSES FROM A MIDWESTERN CITY SCHOOL SYSTEM TO SELECTED PUPIL PROBLEM SITUATIONS. FOR 10 SITUATIONS, THOSE TESTED INDICATED THREE CHOICES EACH OF "WHAT SHOULD BE DONE" AND "WHY IT SHOULD BE DONE" FROM 15…

Procedures for determining cutting scores have been proposed by Angoff and by Nedelsky. Nedelsky's approach requires that a rater examine each distractor within a test item to determine the probability of a minimally competent examinee answering correctly; whereas Angoff uses a judgment based on the whole item, rather than each of its components.…

The reliability of multiple choice tests--containing different numbers of response options--was investigated for 260 students enrolled in technical college economics courses. Four test forms, constructed from previously used four-option items, were administered, consisting of (1) 60 two-option items--two distractors randomly discarded; (2) 40…

The feasibility of generating multiple-choice test questions by transforming sentences from prose instructional materials was examined. A computer-based algorithm was used to analyze prose subject matter and to identify high-information words. Sentences containing selected words were then transformed into multiple-choice items by four writers who…

Test items, all referencing the same instructional objective, are not equally difficult. This investigation attempts to identify some of the determinants of item difficulty within the context of a first course in educational statistics. Computer generated variations of items were used to provide the data. The results were used to investigate the…

A procedure for scoring multiple-choice tests by assigning different weights to every option of a test item is investigated. The weighting method used was based on that proposed by Davis, which involves taking the upper and lower 27% of a sample, according to some criterion measure, and using the percentages of these groups marking an item option…

The experiment described in this bulletin is the result of a previous study of experimental examinations in mathematics (Bulletin No. 2). A basic multifacet test was constructed with 21 mathematical situations in arithmetic, algebra, and geometry and presented in three separate forms: Type 1 Traditional; 2 multi-choice (with four choices); and 3…

The listening comprehension and structure subtests of the Comprehensive English Language Test (CELT) were administered to 211 secondary students from an urban center on Canada's west coast. The subtests appeared to be powerful enough to separate immigrant students of English (Second Language) from Canadian born bilinguals and monolinguals. (EJS)

Undergraduate students took a multiple choice, computer assisted test and received feedback (items with the correct answers identified) either: (1) immediately, item-by-item; (2) following the entire test; (3) 24 hours later; or (4) no feedback. Retention one to three weeks later was significantly better for delayed feedback, and confidence…

The effectiveness of a strategy for improving performance on multiple-choice items for examinees was assessed using an aptitude-treatment interaction model. Results showed that for low-anxious examinees, generation of an answer before selecting a response led to higher performance, but not for highly anxious examinees. (Author/JAZ)

Describes the construction of a chemistry laboratory. Also discusses the place of science in school technology teaching, a study of students' understanding of simple quantitative relationships in chemistry, and the objectives of school physics. (JN)

This study of individual differences in performance of a geometric analogies task included four-alternative test items and studied eye movements and confidence judgments as well as latency and error. Results were interpreted using two hypothesized performance strategies: constructive matching and response elimination. (Author/BW)

Discusses procedures used to evaluate the instructional effectiveness of materials and methods implemented in a self-paced college credit course in library skills. A description of the course and assessment strategies used--multiple-choice assignments, end-of-course test, an attitudinal survey--are included. Twelve references are cited.…

A study conducted at the Universities of Haifa and Tel-Aviv to compare two approaches to constructing general multiple choice ability tests--the "classic distractor" test and a new technique, the "fixed-distractor" format test--found a strong similarity between the scores on the two general information ability tests. Seven…