Reviews arguments in favor of administrative use of public opinion information; demonstrates insights to be gained from examination of poll data; and considers methodological weaknesses of such data and strategies to counter them. (JOW)

The validity generalization model of meta analysis is described and modified for application to concurrent validity studies of motor behavior. An example is presented. (Author/MT)

Habituation to single female faces and to single geometric patterns was observed separately in two groups of infants who participated in two sessions separated by 10 days. Habituation was found to be distributed into three patterns and showed moderate but significant reliability between assessment sessions. (Author/RH)

Outlines issues pertaining to possible sex bias in job evaluation procedures and reviews relevant research. Gives attention to possible sex bias in job analysis procedures, choice and weighting of factors, and reliability and validity issues. Discusses future research needs, particularly reliability and validity aspects of job evaluation…

Spousal response consistency on family decision-making items was examined among spouses in Kentucky. Spousal response consistency was found for all decision-making and task-allocation items. Education level was found to be negatively correlated with response consistency, while low level of spousal tension also was associated with response…

Sixteen measures of reliability for two-category nominal scales are compared. Upon correcting for chance agreement, there are only five distinct indices: Fleiss's modification of A-sub-1, the phi coefficient, Cohen's kappa, and two intraclass coefficients. Recommendations for choosing an agreement index are made based on definitions, magnitude,…

Research articles that applied quantitative techniques and were published in "Journal of Leisure Research" were examined for methodological adequacy. Suggestions to improve leisure research are offered. (DF)

Examples are presented in which it is either necessary or desirable to transform two sets of orthogonal axes to simple structure positions by means of the same transformation matrix. A solution is outlined which represents a two-matrix extension of the general "orthomax" orthogonal rotation criterion. (Author/RC)

Data assembled from assessment centers run by an international manufacturing organization are analyzed for the purpose of evaluating which tests and exercises effectively measure specific traits or characteristics of subjects and which don't. The importance of trained observers is also stressed. (RW).

Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

This topical bibliography and commentary addresses methods of alternative, or informal, assessment that have proven effective, and how these methods have been, or can be, established as reliable alternatives to standardized testing. It discusses authentic assessment, forms of alternative assessment (unstructured written activities, unstructured…

A new scale for self-directed learning oriented toward learners in academic settings and in other environments such as the workplace was developed. Participants were employees of a southeastern state. To obtain reliability estimates, items were developed that asked questions about the employee's behavior in the work environment. Validity was…

This paper illustrates first how estimated Structural Equation Modeling (SEM) measurement error variances are actually estimates of score reliabilities. The major advantage of SEM over other analytic methods is that it accounts for measurement error. Score reliabilities are estimated as part of structural modeling, so that structural models test…

Given the potential value of reliability generalization (RG) studies in the development of cumulative psychometric knowledge, the purpose of this paper is to provide a tutorial on how to conduct such studies and to serve as a guide for researchers wishing to use this methodology. After some brief comments on classical test theory, the paper…

Test validity refers to the degree to which the inferences based on test scores are meaningful, useful, and appropriate. Thus, test validity is a characteristic of a test when it is administered to a particular population. This article introduces the modern concepts of validity advanced by S. Messick (1989, 1996, 1996). Traditionally, the means of…