Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

The naturalistic research perspective assumes that reality is multiplistic, phenomenological, and context-dependent. This perspective legitimizes the subjective insights of the investigator by acknowledging the interdependence of facts and values as well as of the investigator and the object of investigation. Although discrepancies between…

The terms "rigor" and "relevance" most often surface in discussions of methodological adequacy. Assessing epistemological relevance is equivalent to answering the question, "Is this particular research question worth asking at all?" Epistemological rigor refers to the properties of a "researchable" problem.…

This paper provides guidlines for formally evaluating extended-day programs. Extended-day programs are defined as those attended before and after school by children between the ages of 5 and 14. A seven step evaluation process, in which the practitioner responsible for program administration plays a key role, is outlined and discussed. (Author/RH)

The author criticizes a number of research designs in which he finds two recurring defects: (1) the differentiation between research and evaluation, with the belief that the two concepts are incompatible, and that if one objective is chosen as the field of action, the other must be avoided; and (2) the nature of evaluation itself. This second…

The net result of the social-scientific developments in the 19th and 20th centuries is that educational research has inherited a science that is assumed to constitute a disinterested technology of social engineering and a benevolent source of positive social advance. Unfortunately, the social experiment conducted on traditional lines depends upon…

The paper reviews the state of the art in evaluation research of direct instruction projects with handicapped students. The first section delineates research designs used (including norm referenced comparisons, nonequivalent comparison groups, and quasi experimental designs); major findings; and problems with each. A distinction is made between…

Third stream evaluation, the fusing of the ecological perspective with experimental or quasi-experimental evaluation design, is described. The ecological perspective necessitates that the conceptualization and analysis of a setting and the design of the study emphasize the interdependent relations among organisms, behavior and environment in…

A research design is described for the situation in which a program, particularly a compensatory education program funded by Chapter 1 of the Hawkins Stafford Act of 1988, can be evaluated when there is no available comparison group and no pretest data. The design requires content specialists to identify which objectives on the posttest were…

The one group posttest only evaluation model has been identified as a relatively inexpensive and useful model that can identify program components that are not being successful. The use of the model is discussed and illustrated through a hypothetical evaluation of a compensatory (Chapter 1) program. The one group posttest only evaluation model…

As the procedures of evaluation research have developed during recent years, it has become clear that the results of evaluation studies have failed to provide policy decision makers with useful information. An approach towards designing and implementing more useful evaluations--the stakeholder survey--is discussed. Stakeholders are individuals, or…

The use of systems terms and ecological concepts is increasingly common in psychology, and in particular, community psychology. Interest in systems theory began with the development of general systems theory during the 1950's, and led to the adoption of an ecological-systems orientation which recognized the environment as a major determinant of…

The purpose of this paper is to describe the model used to evaluate the two-year Allegany Grant between the Peace Education Foundation and the Miami-Dade County Public Schools that focused on reducing school violence through implementing the "Peace Works" program. A mixed method design using simultaneous methodologies was employed. For…

Program directors and evaluators need to address the important program accountability question of attribution of outcomes. This discussion is a beginning. Starting with some basics, such as the meaning of the program, approaches to program theory development, and the nature of attribution, the paper suggests three types of attribution. An…

A persistent problem in the evaluation of field-based projects is the lack of no-treatment comparison groups. Frequently, potential comparison groups are confounded by socioeconomic, racial, or other factors. Among the possible methods for dealing with this problem are various matching procedures, but they are cumbersome to use with multiple…