This paper describes how work by the United States Office of Personnel Management on the generalizability of employment test validities led to the development of a widely applicable meta-analysis method. The method focuses strongly on estimating the true variance of study correlations and effect size. This validity generalization procedure has…

In behavior research using cognitive and affective measures, there is often incongruity between the statistical analysis employed and the intended inference. This paper argues that incorporating items as levels of a random facet via generalizability theory allows the statistical examination of the inferential question in the desired universe of…

The Stages of Concerns Questionnaire (SoCQ) is an established instrument which has been used primarily with inservice teachers involved in innovations. While it focuses on inservice teachers' concerns about an innovation, the instrument is based on theoretical constructs developed by the work of Frances Fuller and others during the 1960s with…

This paper investigates the reliability of the Florida Performance Measurement Systems' Summative Observation instrument. Developed for the Florida Beginning Teacher Evaluation Program, it provides behavioral ratings for teachers in a classroom setting. Data came from ratings of videotapes of nine teachers conducting actual lessons by nine teams…

Discusses issues relating to the reliability, validity, utility, and information value of unobtrusive testing of library reference services; provides suggestions for practical applications of these criteria; applies study findings to library decision making and planning; and identifies topics for further methodological refinement. (Author/CLB)

This paper assesses the credibility of a single total instrument score and various logical sub-scores derived from a series of summative judgments about the quality of teaching performance. The objectives were to compare the generalizability of alternative Teacher Performance Assessment Instrument (TPAI) scores, to compare the dependability of…