This study examined the effects of certain item selection methods on the classification accuracy and classification consistency of criterion-referenced instruments. Three item response data sets, representing varying situations of instructional effectiveness, were simulated. Five methods of item selection were then applied to each data set for the…

The literature on criterion referenced testing is full of discussions concerning whether classical measurement techniques are appropriate, whether variance is necessary, whether new indices of reliability are needed, and the like. What appears to be lacking, however, is a clear and simple discussion of why the problems occur. This paper suggests…

Classroom Teacher Support System (CTSS) is a prototype system for computer-assisted construction and scoring of tests, using questions from a central data bank. The computer programs for CTSS were developed by International Business Machines Corporation for study in the Los Angeles City Unified School District in 1969 and 1970. In order to provide…

Test construction is not the strictly logical process that we might wish it to be. This is particularly true in a large on-going project such as the National Assessment of Educational Progress (NAEP). Most of the really deep questions can only be answered by the exercise of well-informed human judgment. Criterion-referenced testing is still a term…

Empirical results are presented as regards the implementation of a latent-trait psychometric model by means of conditional maximum likelihood estimation. Items are scored polychotomously into varying numbers of nominal categories and the test and item characteristic curves and information functions are examined. It is concluded that scoring items…

The equivalency of item sampling and student sampling of attitudes of college students was investigated. A factor analysis of student-sampled data collected during Spring 1968, was compared with a factor analysis of item-sampled data collected each quarter from Fall 1968, through Winter 1970, at Mankato State College, using the Campus Environment…

The accuracy of estimating test means for groups of twelfth-grade students by the item-sampling technique was examined. The subjects were from 35 twelfth-grade schools participating in the National Longitudinal Study of Mathematical Abilities. Half of the students in each school were assigned to a treatment condition where they took a complete…

This handbook for training program evaluators provides background information and practice activities in the following areas: (1) measurement: purposes, ideals, possibilities; (2) defining measurement domains; (3) person and item sampling; (4) test and item selection--with a selected list of standardized tests with pertinent information on each,…

The procedure of item sampling was employed to reduce the time expenditure of participants when responding to a questionnaire concerned with the implementation of an innovative elementary school project. Approximately 50 student teachers and 42 regular classroom teachers responded to one of two forms of the questionnaire. There was a total of 103…

A set of Tests of Scientific Thinking were developed for possible use as criterion measures in research on creativity. Scores on the tests describe both quality and quantity of ideas produced in formulating hypotheses, evaluating proposals, solving methodological problems, and devising methods for measuring constructs. (Author/CTM)

The diversity among interpretations of single items in personality questionnaires has been noted previously. Using adjectives from the Adjective Check List (ACL), the study sought evidence bearing on these questions: Does such diversity make the responses to an item not comparable across subjects? If so, what are the implications for scores based…

A test theory using only ordinal assumptions is presented, based on the idea that the test items are a sample from a universe of items. The sum across items of the ordinal relations for a pair of persons on the universe items is analogous to a true score. (SLD)

During the last 2 years (1980-82), selected schools in the Broward County School District in Florida participated in the National Sex Equity Demonstration Project (NSEDP) to create a model for demonstration of curricular materials, educational practices, and program arrangements that feature gender-fair instruction and associated educational…

In discussion of assessment and its applicability to the needs of the Spanish-speaking student population, four types of assessments are presented in the context of the educationally significant testing needed in this area. The focus of this paper is on the use of comprehensive assessment to measure the repertoire of language resources that the…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…