Medical education may lack experiential training on authentic community engagement (CE). Employing a human-centered design approach with medical faculty and students to identify goals, opportunities, needs, and barriers to implementing CE research, we developed an Experiential Community Engagement Learning Series (EXCELS) pilot program. EXCELS…

Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

In higher education, online students are often precluded from research assistantships that are more accessible for campus-based students. At a highly ranked institution for online learning, we developed the Undergraduate Research Program (URP) to address this gap in opportunities for online students. The URP is designed to engage fully distanced…

The geoscience community has begun to grapple with the whiteness of the community and the harm and erasure of Indigenous communities done by earth and environmental scientists. We have come to understand that to recruit and retain Indigenous students, geoscience education needs to be culturally responsive by explicitly centering Indigenous…

Course-based undergraduate research experiences (CUREs) increase student engagement in scientific practices and empower students to generate novel findings. Previous studies have demonstrated that CUREs are more effective at enhancing students' motivations, attitudes, science identity development, and acquisition of science process skills than…

This report from the Career and Technical Education (CTE) Research Network Lead team provides final results from an evaluability assessment of CTE programs that feasibly could be evaluated using a rigorous experimental design. Evaluability assessments (also called feasibility studies) are used in education and other fields, such as international…

The University of Pittsburgh Office of Child Development (OCD) has practiced university-community engagement activities for 30 years. This has included hundreds of specific projects conducted with community partners, all funded by outside grants. Based on our experience, we describe some lessons learned regarding the operation of a…

Funded grant projects all involve some form of evaluation, and Advanced Technological Education (ATE) grants are no exception. Program evaluation serves as a critical component not only for evaluating if a project has met its intended and desired outcomes, but the evaluation process is also a central feature of the grant application itself.…

This article presents the analysis of evaluation methods used in a well-designed and comprehensive evaluation effort of a significant Extension program. The evaluation data collection methods were analyzed by questionnaire mode and timing of follow-up surveys. Response rates from the short- and long-term follow-ups and different questionnaire…

The primary objective of this article is to evaluate the design variables of a newly developed teaching intervention, "The Amazing Tax Race". It comprises a race against time in which accounting students participate within teams in multiple tax-related activities so that they are exposed to pervasive skills. The findings provide…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…