Popular item response theory (IRT) models are considered complex, mainly due to the inclusion of a random factor variable (latent variable). The random factor variable represents the incidental parameter problem since the number of parameters increases when including data of new persons. Therefore, IRT models require a specific estimation method…

Logic modeling, the process that explicates how programs are constructed and theorized to bring about change, is considered to be standard evaluation practice. However, logic modeling is often experienced as a transactional, jargon-laden, discrete task undertaken to produce a document to comply with the expectations of an external entity, the…

Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends…

In this digital ITEMS module, Dr. Stella Kim provides an overview of multidimensional item response theory (MIRT) equating. Traditional unidimensional item response theory (IRT) equating methods impose the sometimes untenable restriction on data that only a single ability is assessed. This module discusses potential sources of multidimensionality…

Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

This article presents an innovative and generalized CIPP evaluation model for breakdance courses based on Hiphop pedagogy, designed to help educators evaluate the design, implementation, and effectiveness of breakdance courses. Despite global interest in breakdance evaluation, few studies have focused on developing a comprehensive evaluation…

Assessment is usually considered as an afterthought in the instructional design process. Given the many challenges of assessment design--and the lack of ready solutions--teachers may fall back on familiar forms of assessments and hope for the best. As a result, the problem is not a lack of will on the part of teachers. Instead, it is the lack of…

We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite requirement on correlation matrices, from sign indeterminacy of factor loadings, and from order constraints on…

Enzymes are nature's catalysts, mediating chemical processes in living systems. The study of enzyme function and mechanism includes defining the maximum catalytic rate and affinity for substrate/s (among other factors), referred to as enzyme kinetics. Enzyme kinetics is a staple of biochemistry curricula and other disciplines, from molecular and…

In recent years, proponents of configurational comparative methods (CCMs) have advanced various dimensions of robustness as instrumental to model selection. But these robustness considerations have not led to computable robustness measures, and they have typically been applied to the analysis of real-life data with unknown underlying causal…

The roles in traditional mentoring dyads are well known across both academic and professional contexts (Dawson, 2014). Despite the universality of these relationships, the way mentorship is evaluated in these relationships is fractured. Evaluation is limited to singular voices, singular points in time and simplified metrics to capture the journey…

In the learning design community, there has been an increasing recognition of the value of positioning teaching as a design science, in which teachers craft and test effective learning conditions through a goal-oriented and evidence-based procedure. However, the existing models and tools supporting teachers' design practice focus primarily on…

For over 30 years, calls have been issued for the western evaluation field to address implicit bias in its theory and practice. Although many in the field encourage evaluators to be culturally competent, ontological competence remains unaddressed. Grounded in an institutionalized distrust of non-western perspectives of reality and knowledge…

This article provides an overview of the unique model and comprehensive approach to tracking, enhancing, and assessing students' global learning outcomes at the University of Pittsburgh's University Center for International Studies (UCIS). In the conclusion, the authors provide a discussion of strengths and challenges of this model that will be…

In carrying out surveys involving sensitive characteristics, randomized response models have been considered among the best techniques since they provide the maximum privacy protection to the respondents and procure honest responses. Over the years, researchers have carried out studies on the estimation of proportions of the population possessing…