Medical education may lack experiential training on authentic community engagement (CE). Employing a human-centered design approach with medical faculty and students to identify goals, opportunities, needs, and barriers to implementing CE research, we developed an Experiential Community Engagement Learning Series (EXCELS) pilot program. EXCELS…

Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for…

Background: Mixed methods research designs in engineering education often frame the "mixed" aspect of the design from the perspective of data collection. However, intentional mixing throughout the research design--particularly during data analysis--may enable richer meta-inferences about a phenomenon. Purpose: This paper provides…

This case study is based on a program evaluation of a professional certificate program that trains early childhood care and education providers to build and support young children's emotional literacy. The research project described in the case study will address approaches to methodological combination, justifying research design and changes to…

The geoscience community has begun to grapple with the whiteness of the community and the harm and erasure of Indigenous communities done by earth and environmental scientists. We have come to understand that to recruit and retain Indigenous students, geoscience education needs to be culturally responsive by explicitly centering Indigenous…

Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts may…

Course-based undergraduate research experiences (CUREs) increase student engagement in scientific practices and empower students to generate novel findings. Previous studies have demonstrated that CUREs are more effective at enhancing students' motivations, attitudes, science identity development, and acquisition of science process skills than…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

This report from the Career and Technical Education (CTE) Research Network Lead team provides final results from an evaluability assessment of CTE programs that feasibly could be evaluated using a rigorous experimental design. Evaluability assessments (also called feasibility studies) are used in education and other fields, such as international…

These are the appendices for the report "The Effects of an Academic Language Program on Student Reading Outcomes." This study investigated WordGen Elementary, a program designed to improve fourth- and fifth-grade students' ability to understand and communicate academic language and their general reading skill. The program provider…

Evaluators of education interventions increasingly need to design studies to detect impacts much smaller than the 0.20 standard deviations that Cohen (1988) characterized as "small." For example, an evaluation of Response to Intervention from the Institute of Education Sciences (IES) detected impacts ranging from 0.13 to 0.17 standard…

Interventions often require multiple decisions to improve outcomes for every student. Whether the decision to implement a practice, tailor an existing protocol, or change approaches, these decisions should be based on individual variables and outcomes via a sequence of treatment. To develop adaptive interventions that have sufficient evidence to…

Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…