The ability of a scientific discipline to build cumulative knowledge depends on its predominant method of data analysis. A steady accumulation of knowledge requires approaches which allow researchers to consider results from comparable prior research. Bayesian statistics is especially relevant for establishing a cumulative scientific discipline,…

Despite abundant data and increasing data availability brought by technological advances, there has been very limited education policy studies that have capitalized on big data--characterized by large volume, wide variety, and high velocity. Drawing on the recent progress of using big data in public policy and computational social science…

There is growing pressure to make efficacy experiments more useful. This requires attending to the twin goals of generalizing experimental results to those schools that will use the results and testing the intervention's theory of action. We show how electronic records, created naturally during the daily operation of technology-based…

While conducting research on the organizational cultures of elite nonprofit organizations in Rio de Janeiro, the author encountered many access issues identified in the current literature: in particular, difficulty in encountering research subjects due to the transitional nature of educational nonprofits and the role of secretaries and…

Credibility in evaluation is a multifaceted concept that involves consideration of diverse stakeholders' perspectives and purposes. The use of a transformative lens is proposed as a means to bringing issues of social justice and human rights to the foreground in decisions about methodology, credibility of evidence, and use of evaluation…

The Regional Educational Laboratories (RELs) are a networked system of 10 organizations that serve the educational needs of 10 designated regions across the United States and its territories. The U.S. Department of Education (ED) is authorized by the Education Sciences Reform Act (ESRA) to award contracts to 10 RELs to support applied research,…

Various analyses have used the transfer rate as a performance indicator for community colleges, but the question of what constitutes an appropriate denominator in the transfer-rate equation remains a point of contention. This article examines the potential drawbacks of using student-reported educational goals to determine which students are…

Improving the quality of reporting could increase the usefulness of research for readers such as parents, students, practitioners, policy-makers, systematic reviewers and other researchers. This paper first presents an analysis of the reporting of basic information about the aims, context and methods used in a sample of published empirical…

Evaluation studies on educational questions attempt to provide answers in the form of conclusions or inferences which are derived from the information collected. Valid inferences are a result of careful research design for the study, and may be causal, descriptive, value-oriented, or probabilistic. Basic steps in designing an evaluation study are…

In the conduct of field studies, there are three different points at which data may be collected unobtrusively. The first is when there is a "search" for an area of study. The second point in which data may be gathered unobtrusively is when the researcher is attempting to further the analysis. The third point in which data are collected…

An evaluator-manager interaction model is developed for predicting the impact of evaluation and research findings. Instruments are developed for measuring the variables of interpersonal involvement, impact of evaluation, and managerial style in the relationship between evaluator and manager. The hypothesis advanced suggests that evaluators can…

The effective utilization of research and development products ranks as one of the top priorities in American public education. The document contains two concept papers by recognized authorities on knowledge utilization activities: A Diffusion Mechanism for the Center for Vocational and Technical Education, Egon G. Guba; and Alternative Diffusion…

Empirical information is presented on how researchers at Swedish institutes of education perceive, structure, and define educational and psychological problems. The collection, evaluation, and presentation of the results of the study were made on the basis of system theoretic assumptions in that the description and analysis of the initial phase of…

As part of an effort to facilitate local problem solving in urban public schools, the Documentation and Technical Assistance Project (DTA) is concerned with clarifying the relationship, or linkage, between research and practice. This paper describes that linkage, which includes two related components: the "definition" of some research…

Examines data analysis at three levels: analysis of data; secondary analysis is the re-analysis of data for the purpose of answering the original research question with better statistical techniques, or answering new questions with old data; and, meta-analysis refers to the statistical analysis of many analysis results from individual studies for…