Defining calibration of comprehension as the correlation between subjective assessments of knowledge gained from reading and performance on an objective test, this paper draws from literature, as well as the findings of original experiments, to examine issues related to the subject . The paper first documents the claim that poor calibration is the…

The validity of interval and time sampling methods of measuring student engaged time was investigated in a study estimating the actual time students spent engaged in relevant motor performance in physical education classes. Two versions of the interval Academic Learning Time in Physical Education (ALT-PE) instrument and an equivalent time sampling…

Cut scores obtained for licensure tests using different judgmental methods of standard setting (holistic, test blueprint, Angoff, and modified Angoff) were compared. Nineteen educators and practitioners participated in this study as judges. Pre- and post-test feedback (feedback of total- and low-group item p-value) ratings were obtained under the…

A target partition analysis (TPA) was used to help seven subject matter experts, with little expertise in testing, evaluate relationships among test items. The subjects were experts in Income Maintenance in the field of public assistance work; they were trainers affiliated with the Professional Development Program's Income Maintenance Training…

A new approach to polychotomous scoring of test items, similar to "max-alpha" scaling (MAS) and known as polyweighting, has been developed. Unlike MAS, this new method of polychotomous scoring provides scoring weights for a given item that are independent of the difficulty of other items in the analysis. Moreover, the scoring weights are…

The Michigan Mathematics Early Placement Test (MMEPT) is an assessment instrument that gives 11th-grade students an appraisal of their mathematical skills in relation to college expectations. Students who take the test receive a report letter that tells them, based upon their test results, approximately where they would be placed in mathematics if…

Application of the Conflict Tactics Scales (CTS) to the assessment of child abuse is described. The CTS is a brief instrument designed to measure three aspects of parent-to-child behavior: (1) reasoning; (2) psychological aggression; and (3) physical aggression. The psychological and physical aggression indexes are intended to measure the…

The reliability and validity of the Inventory of Socially Supportive Behaviors (ISSB), a measure designed to tap behaviors pertaining to the provision of social support, were studied. Data were analyzed on a pre-test sample of 100 adults from a community-based, epidemiologic study of 1,008 black adults in Virginia. Findings are presented on the…

The School Mastery of Reading Test (SMRT) program was designed to give administrators and teachers information about reading performance and recommendations for improving the instructional program. The project includes development of a valid and reliable reading test based on the New York City curriculum in order to assess the potential linkage…

The proposition that the optimal number of options in a multiple choice test item is three was examined. The concept of functional distractor, a plausible wrong answer that is negatively discriminating when total test performance is the criterion, is discussed. Three distinct groups of achievers (high, middle, and low) on a national standardized…

Three standard assessment instruments (Rorschach, Millon Clinical Multiaxial Inventory and 16PF) were administered to 12 participating Rosebud Sioux Indians--6 males, 6 females. Reports were generated for each instrument. Consensual and unique concepts contained in all the reports were analyzed in order to describe the contents. Six judges, all…

Procedures for correcting for guessing and for assessing partial knowledge (correction-for-guessing, three-decision scoring, elimination/inclusion scoring, and confidence or probabilistic scoring) are discussed. Mean scores and internal consistency reliability estimates were compared across three administration and scoring procedures for…

Two methods of researching second language learning are described, analyzed, and compared: student diaries giving a first-person account of the second language learning experience; and participant observation, in which the observer is in the language learning situation recording in descriptive terms all possible data about the situation.…

A model for the validation of standardized tests of academic achievement upon populations not represented in the samples used to standardize the tests is presented, and the results of a field testing of the model are described. The 1973 editions of the Stanford Achievement Test and the Test of Academic Skills were administered to a sample of…

The accuracy of trait estimates obtained from three vertical equating methods was examined. The procedures studied included two anchor test designs and a single-group design. Data from two content areas and two grade combinations were studied. A three-parameter logistic model was used to perform the equatings. The results obtained were used to…