The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

Selection bias pervades the evaluation of supplemental instruction (SI) in non-experimental settings. This brief note provides a formal framework to understand this issue. The objective is to contribute to the accumulation of credible evidence on the impact of SI.

This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

The Individuals with Disabilities Education Improvement Act of 2004 allows schools to use a child's response to research-based intervention (RTI) as a part of procedures to identify students with learning disabilities. This paper considers whether RTI-based assessment models meet ethical and legal standards for acceptable assessment practices.…

Notes that, very early in program planning, budgets are estimated for major program components, including evaluation. Proposes heuristic for establishing reasonable evaluation estimates in initial planning. Describes logical sources of information from which to construct such a heuristic. Recommends that, for typical programs and projects, initial…

Despite the best of intentions, qualitative researchers can be faced, in some circumstances, with having to make meaning from thin, or less than optimal, data. Using a real study as context, the authors describe the ways that they made sense of their thin data on teachers' perceptions of a large-scale evaluation instrument. They propose a…

Four experienced stuttering researchers viewed videodisks of spontaneous speech from chronic stutterers and attempted to locate the precise onset and offset of individual stuttering events. Results showed interjudge disagreements that challenge the reliability and validity of onset and offset judgments. Highly agreed stuttering events were…

Problems with assessment of the quality of life of individuals with intellectual disabilities are cited. The Comprehensive Quality of Life Scale-Intellectual Disability is described as a scale that measures both objective and subjective data, uses simple language, tests for competence in using Likert scales, and covers the full range of quality of…

Since educational criticism aims to reeducate teachers' perception in order to improve or illuminate educational practices, the audience's role is particularly important. In many ways, the intended audience determines the evidence presented. The evaluator must write the criticism in language which is meaningful to the audience (for example…

The purpose of this paper is to discuss the reasons for resistance to evaluation and the factors that affect adoption of new procedures, while focusing on a model for guiding the planning of evaluation implementation strategies. The process of adoption of an innovation occurs in three stages: orientation, where the user identifies benefits;…

Although college faculty may hesitate to evaluate each others' teaching, it is a sensible alternative to evaluation by students or by administrators. Peer evaluations are not only useful for improving teaching, but also affect promotion and tenure decisions. When faculty are rated by observation, repeated visits and rater training are required in…

This discussion of the use of word processing for instruction in developmental writing classes focuses on a study at York College that used IBM PCs and Bank Street Writer software. Problems encountered, including evaluation, assessment, and revising the concept of writing processes, are described. (Author/LRW)

Discussed is the issue of the appropriateness of applied science approaches to evaluation in environmental education. The relationships between characteristics of applied science approaches to evaluation and the special characteristics of environmental education are explored. (Author/YP)

Described is a rationale and process that can be used for the evaluation of environmental education programs. Expectations, planning, results, and using results are all discussed as steps in the evaluation process. (CW)