To determine whether it is necessary for eight College Research Center (CRC) member colleges to use 16 distinct sets of weight in combining four admissions tests scores into predictive composities, a standard set of weights were developed and tested for effectiveness in predicting Freshman Average Grade (FAG). The basic sample in which weights…

This research attempted to interrelate several methods of producing option weights (i.e., Guttman internal and external weights and judges' weights) and examined their effects on reliability and on concurrent, predictive, and face validity. It was concluded that option weighting offered limited, if any, improvement over unit weighting. (Author/CTM)

The concepts of universe of admissible observation and universe of generalization from the generalizability theory were applied to calculate the intraclass correlation coefficient of a licensure test. The internal consistency coefficient of a dichotomously scored test is identical to the intraclass correlation coefficient of a two-facet design.…

The Objective Test Scoring and Performance Rating (OTS-PR) system is a fully integrated set of 70 modular FORTRAN programs run on a VAX-8530 computer. Even with no knowledge of computers, the user can implement OTS-PR to score multiple-choice tests, include scores from external sources such as hand-scored essays or scores from nationally…

This manual is designed to help classroom teachers, instructional designers and test developers, construct sound, challenging and sophisticated paper and pencil exercises that simulate the data-gathering and decision process involved in diagnosing and resolving a problem. It is based on the authors' extensive experience in conducting training…

This memorandum demonstrates a variance components methodology for partitioning the overall design effect (D) for a ratio mean into stratification (S), unequal weighting (W), and clustering (C) effects, so that D = WSC. In section 2, a sample selection scheme modeled after the National Longitudinal Study of the High School Class of 1972 (NKS)…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. The scoring methods under consideration were: (1) formula scoring, (2) a priori scoring, (3) empirical scoring with an internal criterion, and (4) two modifications of formula scoring. The study indicates a clear…

In order to develop tools for use in the selection and vocational-educational guidance of U.S. Naval Academy midshipmen, three empirically-based scales, designed using the Strong Vocational Interest Blank (SVIB), were developed to predict three criteria: (1) disenrollment for academic reasons, (2) disenrollment for motivational reasons, and (3)…

Over the past few decades, higher education has become available around the world to a degree unimaginable to earlier generations. In many ways, accessible mass higher education is the foundation of the modern knowledge economy, and without it, the bright futures of many youth around the world would be dimmed. Preserving and enhancing the…

Predictor weights estimated by using multiple linear regression are biased when there is restriction in the range (RR) of the dependent variable. Standardized multiple regression yields partial correlations as weights for the predictors, and these can be corrected for range difference between calibration and application samples. However,…

A review of the literature concerned with validity data and policies for various methods of treating multiple scores is reported, as are analyses of data from the College Board Validity Study Service. The analyses evaluated the use of Scholastic Aptitude Test--Verbal alone, Scholastic Aptitude Test--Mathematical alone, and the use of both in…

Linear and equipercentile equating conversions were developed for two forms of the Graduate Record Examinations (GRE) quantitative test and the verbal-plus-quantitative test. From a very large sample of students taking the GRE in October 1981, subpopulations were selected with respect to race, sex, field of study, and level of performance (defined…

The purpose of the present investigation was to develop a construct validity approach for testing whether the separation of positive and negative item subscales is substantively meaningful in self-concept research. Results from three published studies using the Self Description Questionnaire (SDQ) III were reanalyzed. The SDQ III measures 13…

Professional assessment of mental retardation (MR) and learning disabilities (LD) is crucial to the implementation of P.L. 94-142 because it necessarily precedes the employment of trained teachers and because a plan for remediation depends on accurate assessment. Intelligence is a key element in the identification of MR-LD, but competent, fair…