When swift, accurate appraisal of evidence is required to inform policy concerning broad research questions, and budgetary constraints limit the employment of large research teams, researchers face a significant challenge which is sometimes met by reviewing existing systematic reviews. In this paper we highlight the challenges inherent in the…

Primary research in education and social sciences is marked by a diversity of methods and perspectives. How can we accommodate and reflect such diversity at the level of synthesizing research? What are the critical methodological decisions in the process of a research synthesis, and how do these decisions open up certain possibilities, while…

Historically, the synthesis of single subject design has employed visual inspection to yield significance of results. However, current research is supporting different techniques that will facilitate the interpretation of these intervention outcomes. These methods can provide more reliable data than employing visual inspection in isolation. This…

Systematic review methodology can be distinguished from narrative reviews of the literature through its emphasis on transparent, structured and comprehensive approaches to searching the literature and its requirement for formal synthesis of research findings. There appears to be relatively little use of the systematic review methodology within the…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

This paper presents an extensive overview of preschool to 12th grade (P-12) engineering education literature published between 2001 and 2011. Searches were conducted through education and engineering library engines and databases as well as queries in established publications in engineering education. More than 50 publications were found,…

There has been much research concerning functional assessment over the past 20 years, but several important research considerations have yet to be explained. One is the comparison of different types of functional assessment (e.g., experimental functional analysis and non-experimental functional assessment). The current study aims to compare the…

Covers some of the issues and procedures used in conducting meta-analysis, a comprehensive and quantitative method for reviewing research, and includes a review of completed meta-analysis in reading. (HOD)

Some guidelines are offered for interpreting and evaluating meta-analytic reviews of research. The choice of unit of analysis, the issue of fixed versus random effects, the meaning of heterogeneity, the determination of appropriate contrasts, and the choice of measures of central tendency are discussed. (SLD)

This paper gives a brief overview of how qualitative and quantitative interviews can be combined to get a fuller picture of a program and its outcomes. This concept is illustrated through a discussion of evaluations of the Employment Intervention Demonstration Program, a multi-site research demonstration project funded by the Substance Abuse…

Arguments between response to intervention (RTI) with curriculum-based measurement (CBM) and traditional, individual psychoeducational assessments encourage a false dichotomy between alternatives that are not mutually exclusive, but complementary. This article discusses strengths and weaknesses of both approaches, touches on current legislative…

The six articles of this issue discuss the place of meta-analysis in the health professions and present two state-of-the-art meta-analyses using a variety of innovative methodologies, statistics, and secondary analytic procedures. A survey conducted for this issue and its sequel explores interventions to facilitate meta-analysis. (SLD)

Focuses on synthesis in research--the combination of thesis and antithesis in the dialectical process, producing a new and higher form of being. Discusses kinds of synthesis (unique communication, plan of operation, abstract relations); synthesizing information pieces; summary practice leading to synthesis; and questions of analysis and synthesis.…

The six chapters of this theme issue attempt to define conceptual and methodological issues in the evaluation of integrated services systems and to begin to synthesize some of these issues. An introduction to these evaluation issues is followed by case studies and a discussion of implications for program and policy development. (SLD)

Because research synthesis enables one to determine either the overall effectiveness of a particular treatment or the relative effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted…