In higher education, online students are often precluded from research assistantships that are more accessible for campus-based students. At a highly ranked institution for online learning, we developed the Undergraduate Research Program (URP) to address this gap in opportunities for online students. The URP is designed to engage fully distanced…

Over the last decade, the idea of societal impact resulting from publicly funded research has changed from being a relatively fringe concern related to high-technology entrepreneurship and spin-off companies to becoming an increasingly important public policy concern. This has stimulated academic science policy research to investigate the impact…

As governments and other organizations worldwide increase their investment in research, the demand for skilled research administrators grows. Researchers need knowledgeable administrators to provide guidance and ensure their projects are administratively managed according to required policies and guidelines. Institutions must ensure their audit…

The Nuremberg Code established ethics for the involvement of humans in research, initially in the area of health and medical research. While aspects of the code have been extended to the social and behavioral sciences, program evaluation does not always implement those policies, procedures, and protocols for protecting research participants,…

This paper documents a case study examining collaborative transdisciplinary (TD) and interdisciplinary (ID) graduate programmes at the University of British Columbia (a large, public, research-intensive university in Canada) -- serving as a model for other universities globally. TD and ID programmes in higher education can ultimately create a new…

Evaluators widely agree that the involvement of key actors is a central aspect of quality practice. However, a scoping review of to what extent and how youth are included has not been explored. This is an important omission because many evaluations are done on programs that directly serve youth. We examined 159 evaluation reports in a publicly…

Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

This article addresses the question of how theatre interventions as elements of a participatory and action-oriented research design can contribute to justice-oriented Caring Community processes. Caring Communities are local initiatives that strengthen everyday solidarity through civic engagement and neighbourhood support, link informal and formal…

Free-listing is a quick, semi-quantitative methodology commonly used by anthropologists to uncover information within a cultural domain. In this method note, we review how anthropologists have used free-listing in a variety of research settings. We then apply the social-ecological framework to describe how free-listing can be used for formative,…

The purpose of this study was to assess and describe the status of program evaluation within the National Science Foundation's (NSF) Research Experiences for Undergraduates (REU) sites. The National Science Foundation's REU program supports thousands of undergraduates annually in hands-on, immersive research experiences under the mentorship of…

Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Research suggests that community college alumni may be underrepresented within PhD programs. As such, we implemented and evaluated the Community College to PhD (CC2PhD) Scholars Program at the University of California, Los Angeles. CC2PhD was a 7-month undergraduate research and PhD preparation program for community college sophomores in the…

Course-based undergraduate research experiences (CUREs) increase student engagement in scientific practices and empower students to generate novel findings. Previous studies have demonstrated that CUREs are more effective at enhancing students' motivations, attitudes, science identity development, and acquisition of science process skills than…