In some settings, the validity of a battery composite or a test score is enhanced by weighting some parts or items more heavily than others in the total score. This article describes methods of estimating the total score reliability coefficient when differential weights are used with items or parts.

In this study, category-based self and peer assessment were applied twice in a semester in an Elementary Science Teaching Methods course in order to assess individual contributions of group members to group projects as well as to analyze the impact of Individual Weighting Factors (IWF) on individual scores and individual grades. IWF were…

Drop jumping has previously been used to measure fast stretch shorten cycle (SSC) ability and stretch load tolerance. To the knowledge of these authors a test does not exist to achieve this in the horizontal direction. The purpose of this study therefore was to estimate the reliability of a new unilateral horizontal leg power test to assess these…

Weighting and variance estimation are two statistical issues involved in survey data analysis for large-scale assessment programs such as the Higher Education Information and Communication Technology (ICT) Literacy Assessment. Because survey data are always acquired by probability sampling, to draw unbiased or almost unbiased inferences for the…

Much previously published material for estimating the reliability of classification has been based on the assumption that a test consists of a known number of equally weighted items. The test score is the number of those items answered correctly. These methods cannot be used with classifications based on weighted composite scores, especially if…

Within aptitude areas (Mechanical, Administrative, General, or Electronic) in the Air Force, some technical schools require higher levels of aptitude for admission than do others (for example, there are G10 schools, G60 schools, and G80 schools based on General test scores in th 10th, 60th, and 80th percentiles respectively). The schools, however,…

This study demonstrates and discusses a new procedure for performing item analysis which utilizes multiple discriminant analysis to establish efficiently and effectively an index of item validity. Application of this statistical technique to data derived from an attitude survey of three groups of students enrolled in technical training courses…

The purpose of this study was to ascertain the functions of the county vocational education director in California as perceived by selected groups of vocational education leaders. The functions were limited to the service responsibilities of the position, exclusive of its administrative responsibilities for the improvement of instruction. An…

This revised manual has been designed to be used by Navy instructors in shore-based schools, training afloat, and components of the Naval Reserve as a guide for the construction and use of achievement tests. The seven chapters cover: 1. Navy Training and Achievement Testing; 2. Performance and Identification Tests; 3. Written Tests; 4.…

It has been shown that Guttman weighting of test options results in marked increases in the internal consistency of a test. However, the effect of this type of weighting on the structure of the test is not known. Hence, the purpose of this study is to compare the factor structure of Guttman-weighted and rights-only-weighted tests and to relate the…

Empirically weighted scores for Rest's Defining Issues Test were found to be more reliable than the simple sum of scores theoretically weighted sum, or Rest's p scores. They also had slightly higher correlations with Kohlberg's interview scores. Empirically weighted scores also showed more significant change in two longitudinal studies. (CTM)

There is a unity underlying the diversity of models for the analysis of multivariate data. Essentially, they constitute a family of models, most generally nonlinear, for structural/functional relations between variables drawn from a behavior domain. (Author)

Conducted a survey of the commissioners and directors of several Rehabilitation Counselor Education (RCE) programs of the Council on Rehabilitation Education (CORE) to determine their preference for using weighted standards in accrediting RCE programs. Results indicated an agreement that standards should be weighted. (Author)

The use of sampling weights in deriving population estimates for the National Assessment of Educational Progress (NAEP) and the effects of nonresponse and undercoverage on those estimates are described. The estimation of sampling variability from complex sample surveys is also reviewed, concentrating on the jackknife repeated replication…

Weighting responses to Constructed-Response (CR) items has been proposed as a way to increase the contribution these items make to the test score when there is insufficient testing time to administer additional CR items. The effect of various types of weighting items of an IRT-based mixed-format writing examination was investigated.…