In this article, we discuss the methodological implications of data and theory integration for Theory-Based Evaluation (TBE). TBE is a family of approaches to program evaluation that use program theories as instruments to answer questions about whether, how, and why a program works. Some of the groundwork about TBE has expressed the idea that a…

Due to repeated observations of an outcome behavior in N-of-1 or single-case design (SCD) intervention studies, the occurrence of missing scores is inevitable in such studies. Approximately 21% of SCD articles published in five reputable journals between 2015 and 2019 exhibited evidence of missing scores. Missing rates varied by designs, with the…

Analysis of symmetrically predicted endogenous subgroups (ASPES) is an approach to assessing heterogeneity in an ITT effect from a randomized experiment when an intermediate variable (one that is measured after random assignment and before outcomes) is hypothesized to be related to the ITT effect, but is only measured in one group. For example,…

While there have been significant developments in the field of inclusive research with people with learning disabilities, there is limited knowledge about the ways inclusive research teams have conducted participatory data analysis. The authors argue this is inherently tied to the sensitivities involved in the inclusive research process. In this…

Policymakers have expressed increased interest in program-level higher education accountability measures as a supplement to, or in place of, institution-level metrics. But it is unclear what these measures should look like. In this report, we assess the ways program-level data could be developed to facilitate federal accountability. Evidence shows…

Dual enrollment is a complex policy issue and is increasingly of interest to state policymakers. Adequate data and data systems are critical to informing dual enrollment policy, yet the data at the federal level and many state data systems suffer from common challenges and lack the capacity to address dual enrollment policy. We review the…

The Education Endowment Foundation (EEF)'s mission is to break the link between family income and educational achievement. This is achieved through summarising the best available evidence in plain language, generating new evidence of 'what works' to improve teaching and learning, and supporting teachers and school leaders to use research evidence…

Purpose: Novice researchers experience difficulties in analysing qualitative data. To develop the skills necessary for qualitative data analysis, theoretical manuals are often insufficient. Supervisors supporting students in analysing qualitative data stress the need for practical guidance, including exercises and feedback. The purpose of this…

Supplemental Instruction (SI) is a voluntary, non-remedial, peer-facilitated, course-specific intervention that has been widely demonstrated to increase student success, yet concerns persist regarding the biasing effects of disproportionate participation by already higher-performing students. With a focus on maintaining access for all students, a…

A mind mapping approach to evaluation called Ripple Effects Mapping (REM) has been developed and used by a number of Extension faculty across the country recently. This article describes three approaches to REM, as well as key differences and similarities. The authors, each from different land-grant institutions, believe REM is an effective way to…

Maps can be a valuable addition to the Web analytics toolbox for Extension programs that use the Web to disseminate information. Extension professionals use Web analytics tools to evaluate program impacts. Maps add a unique perspective through visualization and analysis of geographic patterns and their relationships to other variables. Maps can…

2015 marked the 20th anniversary of the National Languages conference of the AFMLTA. The conference was held in Melbourne with a welcome reception at the Melbourne Immigration Museum and conference dinner in the iconic Eureka Tower. Almost 300 delegates attended the conference from around Australia, as well as a contingent from New Zealand and a…

The Afterschool Alliance, in partnership with MetLife Foundation, is proud to present the final issue brief in their latest series of four issue briefs examining critical issues facing middle school youth and the vital role afterschool programs play in addressing these issues. This brief explores afterschool and data utilization to improve…

The California Children and Families Act of 1998 led to creation of the Kern County Children and Families Commission (First 5 Kern) to support early childhood service programs in Kern County, the third largest county in California that spread a land area as large as the state of New Jersey. In Fiscal Year 2014-15, First 5 Kern administered more…

IES is the primary research, evaluation, and statistics arm of the U.S. Department of Education. Established through the Education Sciences Reform Act of 2002 (ESRA), the Institute's mission is to expand fundamental knowledge and understanding of education and to provide education leaders and practitioners, parents and students, researchers, and…