Makerspaces, especially in their diverse proliferating forms, support a broad variety of learning outcomes. There is rich work in attempting to understand and describe these learning goals. Yet, there is a lack of support for practitioners and educators to assess the learning in events and programming at makerspaces (and similar environments)…

This research aimed to investigate and develop an online system for educational measurement and evaluation with a focus on authentic assessment. The research process consisted of four main stages: (1) analyzing the current state and carrying out qualitative interviews on authentic assessment, (2) developing an online measurement and evaluation…

This scoping review explores leadership training opportunities for school nurses. The review was conducted to inform the development of a new leadership training program for school nurses in Massachusetts. A search conducted across four databases (PubMed, CINAHL, ERIC, and Web of Science) yielded four articles meeting the search criteria published…

Education decisionmakers need access to the best evidence about the effectiveness of education interventions, including practices, products, programs, and policies. It can be difficult, time consuming, and costly to access and draw conclusions from relevant studies about the effectiveness of interventions. The What Works Clearinghouse (WWC)…

We present a framework to help those working in Extension connect program designs with appropriate evaluation designs to improve evaluation. The framework links four distinct Extension program domains--service, facilitation, content transformation, and transformative education--with three types of evaluation design--preexperimental,…

The purpose of this study was to assess and describe the status of program evaluation within the National Science Foundation's (NSF) Research Experiences for Undergraduates (REU) sites. The National Science Foundation's REU program supports thousands of undergraduates annually in hands-on, immersive research experiences under the mentorship of…

This research investigates the linkage between training evaluation, learning design and training transfer. A new training evaluation model, (i.e., learning-transfer evaluation model [LTEM]), was used to examine its ability to provide evaluative evidence through robust assessments in pre-, post- and delayed assessments. The model was used to…

Public libraries have embraced the popularity of maker education and makerspaces by integrating maker education in their program offerings, and by developing makerspaces that enable patrons to tinker and create products. But less attention has been paid to supporting librarians and maker educators in assessing the impact of these spaces. To expand…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

Purpose: The firms use training evaluation practices (TEPs) to determine the return of billions of dollars spent on employee training and development activities. The firms need to modernize the set of TEPs for evidence-based workforce management decisions. This study aims to examine a mediation mechanism to explain how human resource (HR)…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Assessment and recognition are key aspects of microcredentials, and other courses offered on massive open online course (MOOC) platforms. Microcredentials are designed to address the needs of employers and learners looking for units of study at a higher education level aligned with the requirements of labour markets. This paper reviews current…