The unique conceptual framework and language of generalizability theory are presented. While this chapter is relevant to any area in which generalizability theory is applicable, it emphasizes evaluation research, and most examples come from that area. (Author/PN)

Four approaches to estimating interrater reliability in early childhood special education research are illustrated and compared: correlation, comparison of means, percentage of agreement, and generalizability theory techniques. Generalizability theory techniques are proposed as a method for estimating the amount of variance attributable to…

Addresses three issues concerning the assessment of the overrating and underrating of academic competence: (1) the impossibility of separating effects of overrating and underrating from effects of perceived and actual competence; (2) the questionable validity of Connell and Ilardi's method; and (3) the proposal of a new method and its implications…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…