Generalizability theory provides a technique for accurately estimating the reliability of measurements. The power of this theory is based on the simultaneous analysis of multiple sources of error variances. Equally important, generalizability theory considers relationships among the sources of measurement error. Just as multivariate inferential…

The research dealing with the reliability of the Rosenzweig Picture-Frustration Study is surveyed. Analysis of various split-half, and retest procedures are reviewed and their relative effectiveness evaluated. Reliability measures as applied to projective techniques in general are discussed. (Author/DEP)

An alternative derivation of Tryon's basic formula for the coefficient of domain validity or the coefficient of generalizability developed by Cronbach, Rajaratnam, and Glaser is provided. This derivation, which is also the generalized Kuder-Richardson coefficient, requires a relatively minimal number of assumptions compared with that in previously…

Research supported by the National Research Council of Canada, Grant APA-252-2057-B.

Some fundamental concepts of criterion referenced test (CRT) reliability are highlighted. Emphasis is given to the procedures for determining reliability of scores for individual pupils because this is an area requiring increased awareness by classroom teachers and practitioners. Reliability issues encountered in the evaluation of instructional…

Items for a morale scale were selected from Pace's College and University Environment Scales (CUES). The initial morale scale of 55 items was reduced to 22 items without substantially changing the dimension being measured. The scale discriminates among the 100 colleges in Pace's national sample, and its reliability is acceptable. The items-scale…

A critical review of systems of scoring multiple choice tests is presented and the superiority of a system based upon elimination method over one based upon the best answer mode is hypothesized. This is discussed in terms of the capacity of the mode to reveal the relationships among decoy options and the effects of partial information,…

The problem of this study was to determine whether Method A is a more efficient observational method for obtaining activity type behaviors in an individualized classroom than Method B. Method A requires the observer to record the activities of the entire class at given intervals while Method B requires only the activities of selected individuals…

This paper reports results of efforts over a 7-year period (1960-67) to determine if the Hayes Pupil-Teacher Reaction Scale is a reliable, valid unidimensional instrument which may be used to measure the attitude of students toward the teaching effectiveness of their teachers. Criteria used were 1) each respondent's total score describes with at…

Smith (1969) reported the results of an instrument for measuring teacher judgment of written composition. His test was first administered to a group of "experts" whose ratings were in high agreement. Then the test was given to a sample of over 200 teachers and lay readers. Among Smith's conclusions was that over half of the teachers have judgment…

This paper presents an argument against traditional evaluation of students by examination and offers proposals for reform of the present system. Strengths and weaknesses of evaluation methods such as objective tests, use of the year's work, essay examinations, practical examinations, and oral examinations are discussed as well as the need for…

A technique for assessing the agreement between the Q-sorts of two or more groups of subjects is presented which relies on the relationship between the Kendall coefficient of concordance (W) and the Spearman rank order correlation (rho). The proposed statistical treatment of Q-sort data involves the use of a number of intercorrelations rather than…