The terms evaluation, assessment, and appraisal are often used interchangeably in research on schools and pupils. Guidelines for their use and some of the similarities and differences in their meanings are explicated. The concept of evaluation is narrowed to refer to use of information on pupil behavior. Four separate components of…

The purpose of this study was to compare the perceptions of teacher competence within and among three groups of educators as measured by the interview scales of the Instrument for the Observation of Teaching Activities (IOTA). (Auhor)

Although there is a healthy trend toward employment of multivariate statistical methods in the analysis of data from experiments in psychology and education which involve multiple dependent variables, there remains a need to demonstrate the wide variety of data analytic techniques available for post hoc analysis of statistically significant…

The degree to which the chosen units of analysis are likely to produce spurious findings in staged combinations of multiple linear regression procedures are examined. The effects of grouping variables (e.g., classroom, school, and school district) on Procedures such as Coleman's semipartial regression and Mayeske's commonalities, in light of…

The various costs of Type I and Type II errors of inference from data are discussed. Six methods for minimizing each error type are presented, which may be employed even after data collection for Type I and which minimizes Type II errors by a study design and analytical means combination. (Author/CM)

Three common methodological problems in the analysis of observational data include: (1) failure to base degrees of freedom for the analysis on the appropriate sampling unit; (2) the validity of the design and data are inconsistent with the generalizations reached; (3) the statistic used to calculate coder reliability is often inappropriate and…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

This paper examines the development and evaluation of criterion-referenced measures, and elaborates on the distinction between them and norm-referenced measures. The concept of sensitivity is introduced as an appropriate method for evaluating such measures, and a sensitivity index is proposed. The traditional model for the response of a subject to…