This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The What Works Clearinghouse (WWC) systematic review process is the basis of many of its products, enabling the WWC to use consistent, objective, and transparent standards and procedures in its reviews, while also ensuring comprehensive coverage of the relevant literature. The WWC systematic review process consists of five steps: (1) Developing…

There is an increasing interest in the integration of computational thinking (CT) in the K-12 curriculum. By integrating CT into other disciplines, the aim is to equip students with essential skills to navigate domain-specific challenges. This study conducts a systematic review of 108 peer-reviewed scientific papers to analyze in which K-12…

The What Works Clearinghouse (WWC) systematic review process is the basis of many of its products, enabling the WWC to use consistent, objective, and transparent standards and procedures in its reviews, while also ensuring comprehensive coverage of the relevant literature. The WWC systematic review process consists of five steps: (1) Developing…

Behaviorally anchored rating scales (BARS) are an essential component of structured interviews. Use of BARS to evaluate interviewees' performance is associated with greater predictive validity and reliability and less bias. BARS are time-consuming and expensive to construct, however. This report explores the feasibility of gathering participants'…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Parents' motives for home education are one of the most researched topics within home education research. The focus of this article is on the question of the degree to which the results regarding these motives are influenced and shaped by the applied methods and the social context. The empirical basis is a meta-analysis of twelve research…

This paper reports the findings of a Stage I meta-analysis exploring the achievement effects of computer-based technology use in higher education classrooms (non-distance education). An extensive literature search revealed more than 6,000 potentially relevant primary empirical studies. Analysis of a representative sample of 231 studies (k = 310)…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

Experimental research involves comparing two or more conditions. One of those conditions in single subject research is often the baseline. Adequate description of the baseline conditions is necessary for evaluating the effects of independent variables, drawing generalizations from studies, and providing information for subsequent replication…

In response to recent trends and legislation, the concept of implementing evidence-based practices has become a critical component of contemporary schooling. It is important that teachers and families of students with disabilities understand the role that qualitative research plays in determining whether a practice is in fact evidence based.…

A simple way to assess the statistical power of experimental designs, based on the concept of a minimum detectable effect, is described. How to compute minimum detectable effects and how to apply the method of assessment of alternative experimental designs are illustrated. (SLD)

The manner in which results and methods are reported influences the ability of the synthesis of prior studies for planning new evaluations. Confidence ratings, coding conventions, and supplemental evidence can partially overcome the difficulties. Planners must acknowledge the influence of their own judgement in using prior research. (Author)

This book helps students become better and more informed consumers of published research studies. The book provides students with a systematic approach for first identifying whether an article or report should be considered "research," and then understanding the type of research it is and using criteria to judge the research. The book is meant to…

This presentation outlines a perspective on job analysis and comments on research reported at a symposium with reference to that perspective. The perspective discusses two questions pertaining to job analysis that are referred to as the Stage I and Stage II evaluation operations: What should be done? and How well was it done? Stage I evaluation is…