The use of computers to build diagnostic inferences is presented in two contexts: (1) closed world, exemplified by the space shuttle launch monitoring system; and (2) open world, represented by computerized diagnostic testing of reading comprehension. The analysis shows that the closed world provides a substantially cleaner environment within…

The literature on the partial determinants of performance in organizational contexts, particularly the research on situational determinants, suggests several different variables which may be of importance to appraisal processes as well. This point may be exemplified with regard to the situational factors of task ease/difficulty and situational…

It has been hypothesized that college students develop differently in various areas of experience, that they learn to deal with interpersonal relationships early in their college experience, but that they may not have time to develop leisure interests. Instruments designed to assess growth on three of Chickering's student development vectors…

The quality of mathematics multiple choice items and their susceptibility to test wiseness were examined. Test wiseness was defined as "a subject's capacity to utilize the characteristics and formats of the test and/or test taking situation to receive a high score." The study used results of the Graduate Record Examinations Aptitude Test (GRE) and…

This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…

Two psychometric approaches for the investigation of item bias were employed to examine the performance of four sociocultural groups on six subtests of the Wechsler Intelligence Scale for Children - Revised (WISC-R). The sample of 950 students was from Pima County, Arizona. One approach involved the comparison of the psychometric indices of…

The psychometric properties associated with the "specific objectivity" of the simple logistic model are acknowledged to be far superior to those of competing models. It is therefore the ideal model to be used for test development or for the analysis of any measuring instrument developed within a well-defined psychological construct. In…

The results of six major projects are discussed including a comprehensive mathematical and statistical analysis of the problems caused by errors of measurement in linear models for assessing change. In a general matrix representation of the problem, several new analytic results are proved concerning the parameters which affect bias in…

Recent developments in dichotomous factor analysis based on multidimensional item response models (Bock and Aitkin, 1981; Muthen, 1978) provide an effective method for exploring the dimensionality of questionnaire items. Implemented in the TESTFACT program, this "full information" item factor analysis accounts not only for the pairwise…

The author has discovered that errors in grades often occur when scores are combined for final marks. These errors are not related to the grading individual assignments. Rather, they occur when teachers at all grade levels bring individual test and assignment scores together for the students' final grades. Unfortunately, professors of mathematics…

Cognitive style research is hindered by a variety of poorly described measures and style classifications and the use of small samples. This study described and compared three group measures of impulsivity/reflectivity, internal/external locus of control; and field dependence/independence to determine the distribution characteristics, psychometric…

Behavioral measurement using untrained organizational members as raters is highly dependent on heuristic or automatic processes. Such processes direct attention, simplify encoding and storage, and guide recall of behavioral information by using pre-existing schema to simplify processing; however, such processing results in systematic rather than…

A major avenue for dissemination of information among members of a profession is via the professional, scholarly literature published in the major journals within a field. If the role of the school psychologist is changing, this change should be reflected in the current literature. An earlier study traced the published issues and concerns…

This volume, one in a series on modern language testing, collects four essays dealing with current approaches to lanquage testing. The introduction traces the development of language testing theory and examines the role of linguistics in this area. "The Psycholinguistic Basis," by E. Ingram, discusses some interpretations of the term…

Educational assessment tools are used for accountability; selection and licensure, and to measure the effects of instruction for student diagnosis and treatment. Psychometric instruments currently in use are flawed in two ways: they attempt to rank people on fundamentally multidimensional traits, and the problem of the validity of these…