Through a lens for engaged scholarship (Boyer in "Journal of Public Service and Outreach," 1(1), 11-20, 1996) this multiple case study (Merriam, 1996) explores the potential of scholarly podcasts for public knowledge dissemination, highlighting the misalignment of university impact metrics with this medium. Our team collected qualitative…

This reflective piece tells the story of how I started out doing Conversation Analysis (CA) and have been transitioning into doing mixed methods for some years now. My basic argument is that language learning talk is too complex a phenomenon to analyse using a single methodology. Specifically, it is extremely difficult to isolate from the…

This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

Self-regulated learning (SRL) and executive functions (EF) are broad concepts stemming from different research areas. They have been defined and modeled in various ways and are repeatedly related to each other in the literature, but so far, no systematic analyses of these relations have been published. Therefore, a systematic analysis of their…

Computational thinking (CT) is increasingly integrated into education, promoting problem-solving skills essential for the 21st century. However, little is known about how teachers assess CT in K-12 classrooms. This qualitative study explores elementary teachers' approaches to CT assessment after professional development in integrating CT into core…

The rubric, a canonical matrix of criteria presented to students as the road map to academic success. An "Ah-ha" moment, "that is what I'm looking for" utopia for the instructor. While rubrics provide the possibility for solving the complexity of some teaching problems, we have come to know them as a tool that is as useful as…

This book answers a need for pedagogic guidance and instruction in designing, implementing and evaluating global leadership as an academic subject. The book understands global leadership as a social practice and as a comparative subject, analysing how leadership is conceived of and practised in different countries and cultures. At the same time,…

Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

With increasing canonicity, particularly within higher education assessment, the demonstrable achievement of goals, or the delivery of a program, or as one scholar wryly deemed it, the "manipulation of the independent variable" (Moncher and Prinz 1991, p. 247), are commonly referred to as implementation fidelity or fidelity of…

A common problem in the analysis of multiple data sources, including individual participant data meta-analysis (IPD-MA), is the misclassification of binary variables. Misclassification may lead to biased estimators of model parameters, even when the misclassification is entirely random. We aimed to develop statistical methods that facilitate…

This longitudinal, multi-semester study investigates the Integrated Performance Assessment (IPA) in university-level communicative Spanish classrooms to find out how instructor feedback affects student performance on IPA assessments, if at all, and in what ways do teachers and students use feedback from the IPAs in their teaching and learning, if…

Makerspaces are gaining popularity in the educational activities of all age groups, from primary schools to higher education institutions, particularly in science, technology, engineering, and mathematics (STEM) disciplines. Due to makerspaces' hands-on learning approach, it is generally believed that learning in makerspaces influences students'…

As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

Collective impact (CI) is a structured approach that helps drive multi-sector collaborations to address social problems through systems changes. While the CI approach is gaining popularity, practitioners experience challenges in evaluating its implementation and intended outcomes. We conducted a systematic scoping review to understand evaluation…

The use of the aggregate scoring method for scoring concordance tests requires the weighting of test items to be derived from the performance of a group of experts who take the test under the same conditions as the examinees. However, the average score of experts constituting the reference panel remains a critical issue in the use of these tests.…