Research supported by the National Research Council of Canada, Grant APA-252-2057-B.

Some fundamental concepts of criterion referenced test (CRT) reliability are highlighted. Emphasis is given to the procedures for determining reliability of scores for individual pupils because this is an area requiring increased awareness by classroom teachers and practitioners. Reliability issues encountered in the evaluation of instructional…

Items for a morale scale were selected from Pace's College and University Environment Scales (CUES). The initial morale scale of 55 items was reduced to 22 items without substantially changing the dimension being measured. The scale discriminates among the 100 colleges in Pace's national sample, and its reliability is acceptable. The items-scale…

A critical review of systems of scoring multiple choice tests is presented and the superiority of a system based upon elimination method over one based upon the best answer mode is hypothesized. This is discussed in terms of the capacity of the mode to reveal the relationships among decoy options and the effects of partial information,…

The problem of this study was to determine whether Method A is a more efficient observational method for obtaining activity type behaviors in an individualized classroom than Method B. Method A requires the observer to record the activities of the entire class at given intervals while Method B requires only the activities of selected individuals…

This paper reports results of efforts over a 7-year period (1960-67) to determine if the Hayes Pupil-Teacher Reaction Scale is a reliable, valid unidimensional instrument which may be used to measure the attitude of students toward the teaching effectiveness of their teachers. Criteria used were 1) each respondent's total score describes with at…

Smith (1969) reported the results of an instrument for measuring teacher judgment of written composition. His test was first administered to a group of "experts" whose ratings were in high agreement. Then the test was given to a sample of over 200 teachers and lay readers. Among Smith's conclusions was that over half of the teachers have judgment…

This paper presents an argument against traditional evaluation of students by examination and offers proposals for reform of the present system. Strengths and weaknesses of evaluation methods such as objective tests, use of the year's work, essay examinations, practical examinations, and oral examinations are discussed as well as the need for…

A technique for assessing the agreement between the Q-sorts of two or more groups of subjects is presented which relies on the relationship between the Kendall coefficient of concordance (W) and the Spearman rank order correlation (rho). The proposed statistical treatment of Q-sort data involves the use of a number of intercorrelations rather than…

A computer program, written in Fortran IV, is described which assesses reliability by using analysis of variance. It produces a complete analysis of variance table in addition to reliability coefficients for unadjusted and adjusted data as well as the intraclass correlation for m subjects and n items. (Author)

Demonstrates that differences occur in role fidelity and in the performance consistency of a coached client over a series of simulated interviews. Illustrates that such differences can be quantitatively described, and that the results of the frequency tabulation procedure are affected by the training of raters in component observation. (Author)

Reports that the "Readers' Guide to Periodical Literature" provides quick access to popular magazine content, although the titles are not drawn randomly from a universe of publications; that the indexers take an inclusive approach to cataloging; and that the indexers demonstrate high reliability in locating and cataloging full-length…

Recommends criteria for determining adequate sample size for the use of Mean Length of Utterance (MLU) as an indicator of early language development. (BD)