Extended caution indices (ECI) specify the degree of confidence that can be placed in an individual's test score by analyzing patterns of item response. Among the most promising of such indices are the standardized ECIs. Contrary to the literature, several instances were found, in a previous study, of nonnormal distributions of ECIs with samples…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

This manual contains Progress Checks and Tests for use in a Solar Heating Systems curriculum (see note). It contains master copies of all Progress Checks and Unit Tests accompanying the curriculum, organized by unit. (The master copies are to be duplicated by each school so that adequate copies are available for student use in a self-paced student…

A strategy for overcoming problems with the Rasch model's inability to handle missing data involves a pairwise algorithm which manipulates the data matrix to separate out the information needed for the estimation of item difficulty parameters in a test. The method of estimation compares two or three items at a time, separating out the ability…

The HPI Texas Preschool Screening Inventory (TPSI) is a test to help determine which children might be a risk for learning problems as they enter kindergarten or first grade. The HPI Manual describes the procedure, score interpretation, and rationale for seven components of the test, including auditory memory for numbers and letters, visual memory…

Following instructions provided in the teacher's manual, the SCOPE Mathematics Achievement Test booklet for grades K-1 presents 11 mathematical concepts. Testing items include: building appropriate sets; matching equivalent sets; reproducing a given pattern; selecting and/or making an object that is bigger than or smaller than a given object;…

The SCOPE Mathematics Achievement Test booklet for grade 5 presents 11 mathematical concepts with instructions for students to take the test with little or no teacher direction. Testing items include: writing number words; reading and writing numerals in sequence from 0.001 to 100,000; adding and subtracting whole numbers; multiplying up to four…

This study was designed to increase knowledge of the functioning of item bias techniques in detecting biased items. Previous studies have used computer-generated data or real data with unknown amounts of bias. The present project extends previous studies by using items that are logically generated and subjectively evaluated a priori to be biased…

In the answer-until-correct mode of multiple-choice testing, respondents are directed to continue choosing among the alternatives to each item until they find the correct response. There is no consensus as to how to convert the resulting pattern of responses into a measure because of two conflicting models of item response behavior. The first…

As one in a series of test item collections developed by the Assessment and Evaluation Unit of the Directorate of Studies, items are made available to teachers for the construction of unit tests or term examinations or as a basis for class discussion. Each collection was reviewed for content validity and reliability. The test items meet syllabus…

Ways in which the Statistical Package for the Social Sciences (SPSS) can be used to perform some Rasch analyses are described in detail. It is shown how SPSS and a set of item calibrations can be used to estimate person abilities, standard errors of measurement, test characteristic curve, test information curve, classification consistency on a…

A new system of order analysis, developed by Takeya and called Item Relations Structure Analysis (IRSA), was described and used for examining the structural relations among a set of 24 items on the addition and subtraction of fractions. A diagraph showing 16 chains of items that had discernibly common features was generated by this method, and…

Item banks offer a different approach to test development than that of the more traditional item specification method. This study was designed as an initial comparative investigation in the Area. Fourth grade math and reading tests were developed using both items written from item specifications and items drawn from an existing item bank. Four…

This study was conducted to test the effect of practice or adjunct questions on learning in a real-world training environment. Subjects were 289 males enrolled in a self-study Naval communications course. Subjects were assigned to one of three experimental groups which received workbooks, or to a control group which did not receive workbooks. The…

To test for item bias, it must be determined whether an item fits the model. Two approaches to defining bias within the framework of the Rasch model are examined. One compares within-group fit mean squares and the other utilizes a between-group fit statistic. Results from both approaches overlap somewhat, but are distinct in many different but…