The field of learning analytics is rapidly developing techniques for using data captured during online learning. In this article, we develop an additional application: the use of analytics for improving implementation fidelity in a randomized controlled efficacy trial. In an efficacy trial, the goal is to determine whether an innovation has a…

This paper proposes a framework for analyzing program design features that seem to matter in implementation. The framework is based on findings from a study conducted by the Consortium for Policy Research in Education (CPRE) between 2004 and 2007 that explored how reform ideas and practices created by five external provider organizations were…

Cooperative and Work-integrated Education (CWIE) programs have been widely accepted as educational programs that can effectively connect what students are learning to the world of work through placements. Because a global quality standards framework could be a very valuable resource and guide to establishing, developing, and accrediting quality…

Building Assets Reducing Risks (BARR) is a social emotional model that achieves academic outcomes through combining use of real-time student data with proven relationship-building strategies and intensive teacher collaboration to prevent course failure. BARR is a recipient of US Department of Education "Investing in Innovation (i3)"…

When different individuals operating in different contexts implement similar innovations, they approach the various parts of the innovation in different ways. When assessed according to the research procedures used to study innovation implementation at the Research and Development Center for Teacher Education at the University of Texas at Austin,…

In 1987, the Chancellor's Office of the California Community Colleges (CCC) began implementation of the Management Information System (MIS) to improve its data collection and analysis capabilities by utilizing electronic mail communications systemwide. Specifically, the project seeks to replace paper copies of data generated for reporting…

Preliminary findings of this research effort provide support for the hypothesis that existing databases maintained by federal agencies for administrative or monitoring purposes can serve as useful data sources in special education policy research. The research explored the relationships among a number of state-level special education, fiscal, and…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

This study evaluated the implementation of and the outcomes from a local child parent center compensatory education program. It intended to contribute to a better understanding of one phase of compensatory education; and, in the process, it proposed to develop a relatively simple and practical evaluation strategy which would verify the…

This paper reports the results from an investigation of a method for systematic development of a procedure for assessing the administrator and instructional leader roles in implementation of an innovative school program. The purpose of the study was to design and field-test a feasible and useful approach to examining the degree of…

The movement toward integration of qualitative and quantitative research methods within the same study has been most evident in social policy research. Four major approaches to integrating can be identified in recent studies. The sequential, the parallel, and the fused models have been rather widely used. The interactive model, developed during…

This paper provides a rationale for studies of educational program implementation and offers a causal model for program evaluation emphasizing pupil-related variables that intervene between program implementation and outcome variables. The rationale is followed by a discussion of implementation as an evaluation construct. Process, independent…

This paper presents a framework for monitoring implementation which defines a process for implementing new programs into organizations. The process requires a team of monitors who examine the adequacy of implementation plans and look at the effect of plan execution upon the organization, individual, and new program. Immediate feedback is provided…

Focusing on the use of the interview in the Procedures for Adopting Educational Innovations (PAEI) Project, this paper reports on the appropriateness of the interview as a research tool in change research and the types of information appropriate to its use. In this project, interviews are used to identify what an individual is doing, has done, or…

An approach to research that was conceptualized with the idea of replicating one study in dozens of locations simultaneously is described, focusing on two research projects with simultaneous replication. In 1988 researchers in 85 locations collected data in 276 schools as part of the Phi Delta Kappa Study of Schools At Risk. In 1982, data were…