A general linear model (GLM), using least-squares techniques, was used to develop a criterion measure to replace freshman year grade point average (GPA) in college admission predictive validity studies. Problems with the use of GPA include those associated with the combination of grades from different courses and disciplines into a single measure,…

This report describes and summarizes findings on four National Teachers Examination tests provided by 45 faculty reviewers from six Oregon institutions of higher education. The tests were judged on the basis of students' opportunity to learn knowledge measured in test items and the importance of knowledge of items for beginning teachers. Tests…

To facilitate the proper technical use of the test scores obtained from the administration of the tests, the curricular and psychometric characteristics of the tests are described in a series of technical manuals. This manual, the seventh in the series, contains a description of the characteristics of the North Carolina Test of Chemistry. The test…

Focusing on the problems of validity and representativeness of samples, a study examined the history of literacy in the United States since 1880 in order to set the contemporary debate on test scores, literacy and reading performance in the longer-range perspective of the last 100 years. The quality of the data and the arguments of literacy…

This study used generalizability theory and other statistical concepts to assess the application of the Angoff method to setting cutoff scores on two professional certification tests. A panel of ten judges gave pre- and post-feedback Angoff probability ratings of items of two forms of a professional certification test, and another panel of nine…

This study sought to validate two measures of social cognitive development: a measure of conflict resolution (Shantz and Shantz, 1982), and a social rule measure (Shantz, 1982). Participants were 214 kindergarten through fourth grade children from two suburban schools, one a public school and the other a Catholic parochial school in the Chicago…

This document describes the development and assessment of a methodology for generating on-the-job-training (OJT) task proficiency assessment instruments. The Task Evaluation Form (TEF) development procedures were derived to address previously identified deficiencies in the evaluation of OJT task proficiency. The TEF development procedures allow…

Steps are outlined in the construction of two self-report assessment scales designed to measure general life satisfaction and leisure activity levels of developmentally disabled adults. The potential usefulness of a reliable, valid self-report instrument as a measurement tool in client programming is noted in the context of a review of similar…

In fall 1985, a study was conducted at Broome Community College (BCC) in Binghamton, New York, to determine whether students who added a class on or after the first class meeting (i.e., late admits) were at greater risk of withdrawing or failing than students who registered on time (i.e., regular admits). Final grades awarded to students in ENG…

Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

This paper presents criteria for establishing the trustworthiness of naturalistic inquiries, and specific techniques to facilitate their achievement or determine the degree of their achievement. The following criteria are briefly described: fairness; and ontological, educative, catalytic and tactical authenticity. Explored in greater detail,…

A more familiar and efficient method for estimating the parameters of Cason and Cason's model was examined. Using a two-step analysis based on linear regression, rather than the direct search interative procedure, gave about equally good results while providing a 33 to 1 computer processing time advantage, across 14 cohorts of junior medical…

Because research synthesis enables one to determine either the overall effectiveness of a particular treatment or the relative effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted…

Methods for examining the viability of assumptions underlying generalized linear models are considered. By appealing to the likelihood, a natural generalization of the raw residual plot for normal theory models is derived and is applied to investigating potential misspecification of the linear predictor. A smooth version of the plot is also…

This study investigated the construct validity of five perceptual traits (auditory discrimination, visual discrimination, visual memory, visual-motor coordination, and auditory to visual-motor coordination) with five simulated work samples (union assembly, resistor reading, budgette assembly, lock assembly, and nail and screw sort) from the Jewish…