Despite continued research into the Community of Inquiry (CoI) framework, the best way to measure each presence of the framework, and in particular social presence, has not been effectively settled in prior research. The purpose of this study was to evaluate the validity of the social presence items in the CoI framework and its subscales, as well…

This scoping review examines the landscape of educational evaluation research in Asia over the past decade, uncovering the methodologies, themes, and unique regional challenges within this domain. By delving into 62 articles from evaluation-centric journals, the study reveals a predominant focus on learning, teaching, and assessment, highlighting…

Critiquing journal articles can be intimidating, especially for new scholars. Many new graduate students focus on the findings and discussion rather than the quality of the research. This methodology review guide is our tool to help scholars identify and evaluate a research article, particularly focusing on the methodology. Although there are some…

Evaluation is essential to achieving program outcomes, especially when stakeholders engage with evaluation and make use of the findings. Both of these activities require evaluation capacity that might not be present in community-based organizations. In this paper, we describe how community-university partnership models can support evaluation…

Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing…

This article discusses the author's belief that if assessment is going to have an impact, it must be woven into the larger tapestry that tells the tale of a student experience that leads to student and institutional success. Included are considerations for how to design meaningful ways to measure movement on the things that people care about.

One expected outcome of physics instruction is that students develop quantitative reasoning skills, including strategies for evaluating solutions to problems. Examples of well-known "canonical" evaluation strategies include special case analysis, unit analysis, and checking for reasonable numbers. We report on responses from three tasks…

Anxiety is a multifaceted force that can negatively impact the ability of evaluators to succeed in practice. In the evaluation literature, discussions concerning anxiety have primarily been limited to strategies to reduce stakeholder anxiety to encourage positive and productive working relationships with evaluators. This study was among the first…

The world has experienced rapid changes, leading to pressing issues such as environmental degradation, social inequality, and resource depletion. As a transdisciplinary field, evaluation has emerged as a crucial tool in addressing these challenges and promoting systemic change. However, concerns have been raised regarding the field's capacity to…

In graduate evaluation education, research has shown that theory to practice is overshadowed by a focus on practical methods which results in evaluation education tension and a tenuous understanding of evaluation theory to practice when evaluators complete their graduate studies. Little is understood about evaluation theory to practice from…

Meaningfully engaging faculty in assessment presents a continual challenge for general education administrators. Faculty perceptions of assessment--including that assessment serves no purpose other than "checking a box" for accreditation and that it conveys little benefit to the instructor--often hinder instructor engagement. A low-cost…

Enhancing student learning, a primary purpose of assessment, can be fostered through integrating modified program theory and implementation fidelity processes into curricular, instructional, and assessment practices. Another assessment priority, reporting student learning outcome results for accreditation which may include inadequate evidence…

"Through-year assessments" are assessments that are administered in multiple parts and at different times over the course of a school year that also produce summative scores that can be used with state accountability systems (Lorié et al., 2021; Dadey & Gong, 2023). These assessments are alternatively known as instructionally…

In many sectors and in many respects, interdisciplinarity has made progress in recent decades, but less so when it comes to evaluating interdisciplinary work. Challenges remain, especially regarding what counts as 'good' interdisciplinarity. While previous reviews describe broad trends contributing to these challenges, high-level observations are…

Since the beginning of the 21st century, evaluability assessments have experienced a resurgence of interest. However, little is known about how evaluability assessments have been used to improve future evaluations. In this article, we identify characteristics, challenges, and opportunities of evaluability assessments based on a scoping review of…