Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Computation is foundational to learning many mathematics concepts, as well as a functional skill in everyday life. Yet students with autism spectrum disorder (ASD) often have challenges in learning computation skills. The current study aimed to provide quantitative and descriptive analyses of single-case experimental studies on computation…

Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Multitiered systems of support provide a framework for matching the needs of a struggling student with an appropriate intervention. Experimental evaluations of tiered support systems in grade schools have been conducted for decades but have been less frequently examined in early childhood contexts. A recent meta-analysis of multitiered systems of…

The practice of homeschooling still receives contrasting responses on its relevancy and effectiveness. The current study is aimed to map the trends in the selected eleven studies from various educational journals. The analysis focuses on mapping the trends on: a) research settings, b) target sample, c) method or instrument used, d) common focus or…

Background/Context: School finance litigation has often prompted funding reforms, but what happens as a result is the subject of considerable dispute. Purpose: This article explores design problems encountered in studies examining the nature and effects of those reforms. Analysis: After describing the development and current status of school…

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

Remediation is the most common policy designed to prepare students academically and socially during their early stages of college. But despite its profound importance and its significant costs, there is very little rigorous research analyzing its effectiveness. The goal of this paper is to provide a conceptual framework for evaluation of remedial…

The paper reviews the state of the art in evaluation research of direct instruction projects with handicapped students. The first section delineates research designs used (including norm referenced comparisons, nonequivalent comparison groups, and quasi experimental designs); major findings; and problems with each. A distinction is made between…

A review of qualitative methods used in a predominantly quantitative evaluation indicates a variety of roles for such a mixing of methods, including framing and revising research questions, assessing the validity of measures and adaptations to program implementation, and gauging the degree of uncertainty and generalizability of conclusions.…

Examines the problem of attrition from therapeutic treatment programs, discussing the scope and limitations of research about the causes of subject attrition. Examines the applicability of proposed methodological remedies for assessing and countering attrition. Such research often suffers from inadequate conceptualization and weak design. (SLD)

Two specific methods of analysis in large-scale evaluations are considered: structural equation modeling and selection modeling/analysis of non-equivalent control group designs. Their utility in large-scale educational program evaluation is discussed. The examination of these methodological developments indicates how people (evaluators,…

Designed to identify sources for planning longitudinal evaluation strategies, this paper provides an overview and bibliography of resources regarding vocational follow-up and presents a conceptual model for longitudinal program assessment. Introductory material highlights major works in the area of vocational program assessment and summarizes the…

The National Assessment of Educational Progress (NAEP) has been the subject of many evaluations during its history. Those evaluations are reviewed, focusing on external evaluations, and the influences of recommendations made in the evaluations are discussed. The report concludes that many of the recommendations of evaluators have been heeded by…

Presents the conceptual, philosophical, and methodological basis for the "Procedural and Coding Manual for Review of Evidence-Based Interventions." Discusses key conceptual issues and areas of potential controversy surrounding the manual and the research framework for coding evidence-based interventions (EBIs). Presents methodological…