Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

The geoscience community has begun to grapple with the whiteness of the community and the harm and erasure of Indigenous communities done by earth and environmental scientists. We have come to understand that to recruit and retain Indigenous students, geoscience education needs to be culturally responsive by explicitly centering Indigenous…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

Evaluators must employ research designs that generate compelling evidence related to the worth or value of programs, of which assessment data often play a critical role. This article focuses on assessment design in the context of evaluation. It describes the process of using the Framework for K-12 Science Education and Next Generation Science…

The regression discontinuity design (RDD) has the potential to yield findings with causal validity approaching that of the randomized controlled trial (RCT). However, Schochet (2008a) estimated that, on average, an RDD study of an education intervention would need to include three to four times as many schools or students as an RCT to produce…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

The Race to the Top Assessment program was authorized as part of the American Recovery and Reinvestment Act of 2009 (ARRA). In September 2010, the U.S. Department of Education (Department) awarded competitive, four-year grants to two consortia of states, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter…

The purpose of this review is to learn from rigorous evaluations of alternative technology applications how features of using technology programs and characteristics of their evaluations affect reading outcomes for students in grades K-12. The review applies consistent inclusion standards to focus on studies that met high methodological standards.…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

This research assesses the impact of the AB 803 Adoption/Expansion Program, a grant program that encourages schools to startup or expand their use of educational technology. The report summarizes how various grant programs have been prepared and how funds were applied at schools. The report also identifies factors that enhance or inhibit use of…

Discusses four design issues related to the development or selection of an appropriate measurement instrument for evaluation or research in nutrition education: data sources, response format, collection mode, and referent. (DC)

A research design for evaluation of environmental education centers by means of the case study method is explained. Validity, reliability, and some ethical principles when writing the report are also mentioned. An example is given of a pilot case study conducted by the author. (LZ/Author)

The monograph defines and discusses single subject research designs in special education. Advantages of this approach with measuring change in handicapped children are noted. Observational techniques (event recording, duration recording, interval recording, and time sampling) are described, along with three types of single subject evaluation…