This article is based on a presentation that was made at the 2014 annual meeting of the editorial board of "Health Education & Behavior." The article addresses critical issues related to standards of scientific reporting in journals, including concerns about external and internal validity and reporting bias. It reviews current…

The appropriate implementation of innovation is a crucial factor in improving educational practice. In the implementation process, there is, however, often a lack of interaction between designers and practitioners that would enable the latter to become competent enough to implement theoretical knowledge into practice and to have an ongoing support…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

To meet demands for accountability, most schools and departments of education at institutions of higher education (IHEs) gather information on their current students and graduates. This paper describes issues to consider when designing a longitudinal data collection and management system, drawing on seven years' experience developing such a…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

The Center for the Advancement of Engineering Education was founded in 2003 with five collaborating institutions. A multi-institutional, multi-year grant offers many opportunities for the demands of reality to interfere with design goals. In particular, at Colorado School of Mines (CSM) student demographics required adjustment of the original APS…

This article explores the applicability of interdisciplinary research on the implementation of technological innovations to the field of e-learning research. Arguing that there are important ways in which e-learning systems can be treated as "technological innovations," this article presents a review of several key theoretical and research design…

Investigated is the topic of research implementation and how it can affect evaluation results. Even when evaluations are well planned, the obtained results can be misleading if the conscientiously-constructed research plan is not correctly implemented in practice. In virtually every research arena, one finds major difficulties in implementing the…

Analysis of the assumptions underlying the stakeholder approach to evaluation combined with the limited experience in testing the approach reported in this volume, suggests that some claims are cogent and others problematical. (Author)

Besides identifying current problems in educational change research, this document describes the inadequate paradigm on which past research has been based and outlines a currently emerging paradigm of educational innovation. The author asserts that previous research findings have been inconsistent and not comparable. Basic to the research problems…

This Digest argues that management factors are central to youth program successes and failures and that these factor have been ignored in research on youth programs. Instead, the Digest notes that research and evaluation of programs have focused on the following: (1) whether the right audience is served; (2) whether to make incremental…

This report explores the field research experience of the Documentation and Technical Assistance Project, an activity of the Center for New Schools in Chicago, Illinois. Using ethnography as a major research tool, DTA studied nine school sites, documented information on how the schools solved problems to bring about school improvement; and…

The site variability issue for Direct Instruction Follow Through sites is examined from a variety of perspectives--meta-analysis of the Abt Associates' data, norm-referenced comparisons, and a longitudinal look at stability of effects. Much of the seemingly unexplained variability found in both the Abt report and the reports by M. Kennedy and E.…

After a brief introduction indicating the value of the first Follow Through evaluation, this document offers ideas about how a new wave of Follow Through approaches should be evaluated. The discussion is based on the premise that the form of an evaluation must be derived from the questions for which answers are sought, the audience(s) to whom the…

The movement toward integration of qualitative and quantitative research methods within the same study has been most evident in social policy research. Four major approaches to integrating can be identified in recent studies. The sequential, the parallel, and the fused models have been rather widely used. The interactive model, developed during…