The COVID-19 pandemic positioned digital education in a new light. The need for educational institutions to develop strategies, standards and establish quality assurance across digital education became even more evident. This paper describes the four-step process of designing an interactive "European Union (EU) Digital Education Quality…

Evaluation has not been used to its fullest potential in environmental education (EE). Pressures from external stakeholders can cause organizations to focus on reporting requirements at the expense of conducting evaluations that support programmatic improvement. Understanding practitioners' satisfaction with their evaluation processes and the…

This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

The study evaluates the Mythematix prototype, an innovative adaptive e-learning system designed specifically to enhance secondary school students' understanding and proficiency in mathematics. Utilizing a mixed-methods approach, it combines qualitative and quantitative research methodologies to thoroughly assess students' perceptions and…

This report presents findings from an evaluation of the Air Tutors math program during the 2023-24 school year in two school districts: District A in Colorado and District B in Texas. It examines student participation rates and the program's impact on math achievement as measured by both state standardized summative assessments and district-level…

The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how…

Well-designed instructional programs seamlessly promote human performance. Students are often unaware of countless iterations of formative evaluation completed to improve effectiveness, efficiency, motivation, and flow of that instructional design. This paper examines one research-based, comprehensive, systematic evaluation approach as applied by…

The mid-term evaluation of the Partnership for ODFL in the Pacific Project was commissioned by the Commonwealth of Learning to examine the initial two years of the five-year activity. The evaluation was undertaken by Standard of Proof, the MFAT MERL panel, providing specialist services in monitoring, evaluation, measurement and research and…

LXD Research was engaged by 95 Percent Group to conduct a third-party, mixed-methods efficacy study of their 95 Phonics Core Program (95 PCP) to evaluate the impact on fourth and fifth grade literacy outcomes over the school year 2023-2024. LXD analyzed the formative assessment data from i-Ready, focusing on overall scale scores, subdomains, and…

Logic models have garnered acclaim for their usefulness and disdain for the time required to create good ones. We argue that the orderly, analytical nature of logic models is opposed to many Extension programs, and we explain developmental evaluation, an approach that highlights ongoing development, adaptations, and rapid response. We use our…

Media literacy (ML) education has emerged as a promising approach to slowing the spread of "Truth Decay," described as the diminishing role that facts, data, and analysis play in political and civil discourse. Several factors contribute to Truth Decay, including a rapidly evolving information ecosystem and overburdened educational…

Although many have suggested the use of games to motivate active learning, studies that evaluate the learning outcomes of games with high school students are scarce. Here, we present the evaluation of the board game "Taphonomy: Dead and Fossilized" as an active learning tool to teach fossilization and Earth systems thinking with rising…

Program participants have been largely excluded as an evidence source in realist evaluations. We test whether and how lived experience as described through life history interviews with pilot program participants can be used as a valid and unique source of data for elucidating context (C)--mechanism (M)--outcome (O) configurations and informing…

In 2016, following a request from the Minister for Education and Training, the Higher Education Standards Panel (HESP, 'the Panel') delivered 14 recommendations to achieve greater transparency in the admissions information for higher education. This report presents the Tertiary Education Quality and Standards Agency's (TEQSA's) summative…

Positive mentorship perceptions relate to higher intent to persist (Baier et al., 2016) and sense of belonging (e.g., Apriceno et al., 2020). Apriceno and colleagues (2020) used multiple survey items to examine student engagement with mentors, but they were unable to consider how mentors incorporate Black, Indigenous and People of Color (BIPOC)…