This paper deals with the problems that arise in performance assessment from the granularity that results from having a small number of tasks or prompts and raters of responses to these tasks or prompts. Two problems are discussed in detail: (1) achieving a satisfactory degree of reliability; and (2) equating or adjusting for differences of…

One of the changes in the test stimuli of the Wechsler Intelligence Scale for Children III (WISC-III) was the addition of color artwork on the Picture Completion (PC) and Picture Arrangement (PA) subtests. While the reactions of children and examiners to the color were positive during pilot testings and tryout, studies examining the effect of…

Although perfectly scalable items rarely occur in practice, Guttman's concept of a scale has proved to be valuable to the development of measurement theory. If the score distribution is uniform and there is an equal number of items at each difficulty level, both the elements and the eigenvalues of the Pearson correlation matrix of dichotomous…

This paper discusses the use of latent class structure as a modelling framework for tests in which much of the data conforms to a relatively small number of systematic patterns. Application of this framework to the analysis of tests has been limited because available parameter estimation algorithms can only handle a relatively small number of…

Three item response models were evaluated for estimating item parameters and equating test scores. The models, which approximated the traditional three-parameter model, included: (1) the Rasch one-parameter model, operationalized in the BICAL computer program; (2) an approximate three-parameter logistic model based on coarse group data divided…

By means of a literature search and data from the California Coalition for Sex Equity in Education (CCSEE) questionnaire (the Title IX Implementation Assessment Instrument), this report presents the findings a 2-year (1978-80) study of sex bias and Title IX compliance in California at 23 experimental and 13 control school districts. The report…

A brief overview of item response theory is provided, and a 186-item bibliography of books and articles on the subject dating from 1953 to June 1989 is presented. The overview includes a definition of the theory, a discussion of its development and application, and comparisons with classical test theory. All publications in the bibliography were…

The purpose of this study was to evaluate the utility of out-of-level testing (OLT) when it is applied to the assessment of special education students with mild learning handicaps. This evaluation of OLT involved testing hypotheses related to: (1) the adequacy of vertical scaling, (2) the reliability and (3) the validity of OLT scores. Fifty-eight…

An approach was developed based on item-response models defined at the level of salient subject groups rather than at the level of individuals, designed for use with multiple-matrix sampling designs. In each of three National Assessment of Educational Progress (NAEP) mathematics subtopics, Reiser's group-effects latent trait model was fitted to…

This study addressed seven questions regarding the methods used in setting passing scores on the essay subtest of the National Teacher Examinations (NTE) Communication Skills test for the North Carolina State Board of Education. North Carolina uses these tests to screen prospective applicants to teacher education programs. The judges (five college…

A detailed description is provided of the variable general implementation of the instructional programming model (GOSA), which is part of the analysis in phase I of the Evaluation of Practices in Individualized Schooling. The variable is defined; the questionnaires on which the variable is based are listed; the procedures used to scale the…

The methodology employed in 14 motivational orientation studies was reviewed. All studies used either the Education Participation Scale, the Continuing Learning Orientation Index or the Reasons for Educational Participation Scale. Issues discussed concerned factor scoring, factor analysis, rotation, scaling, reliability, and the extent to which…

A telephone survey was conducted in an attempt to test the veracity of some of the traditional questionnaire items commonly associated with the assessment of the Public Television image. The results of the survey indicated that items commonly used in these assessments (production competency, worthwhileness of minority programing, interest of the…

This investigation was designed to identify scales indicative of the development of problem-solving behavior in young children, and to discover whether children of different backgrounds exhibit similarities in the order of development and levels of achievement of problem-solving behaviors. Items from twenty-two tests were selected for use.…

Discusses the classification of binary oxides as acidic, basic, or amphoteric. Demonstrates how a numerical scale for acidity/basicity of binary oxides can be constructed using thermochemical data for oxoacid salts. Presents the calculations derived from the data that provide the numeric scale values. (TW)