This study argues that readability formulas should be used as one measure of linguistic equivalence when adapting psychometric scales from one language to another. Assuming that the psychological structure being measured was not changed, it was observed that calculated readability levels and interpretations were different for two different…

The leaders of Networks for School Improvement (NSIs) have complex, challenging jobs which require constant learning and adaptation. To support these leaders, the contributors to this volume have developed a survey-based data visualization system--the Improvement Network Health Development (INHD) Information System--designed to generate insight…

The aim of the current paper is to offer a unique perspective on eye movement analysis in reading research by applying techniques from social network analysis to examine integration processes between sentences during reading. In a first step, we explored how network measures relate to the often-used duration measures in reading research in order…

Despite continued research into the Community of Inquiry (CoI) framework, the best way to measure each presence of the framework, and in particular social presence, has not been effectively settled in prior research. The purpose of this study was to evaluate the validity of the social presence items in the CoI framework and its subscales, as well…

Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

Regression discontinuity (RD) designs are increasingly used for causal evaluations. However, the literature contains little guidance for conducting a moderation analysis within an RDD context. The current article focuses on moderation with a single binary variable. A simulation study compares: (1) different bandwidth selectors and (2) local…

The present work assessed a quizzing method that combines the benefits of retrieval practice and feedback, whereby learners must continue taking quizzes until they achieve a perfect score with feedback provided (i.e., "mastery quizzing"). Across four experiments (n = 952; age 18-76, M = 37.10, SD = 11.61; 50% female, 48% male, 2% other…

Mokken Scale Analysis (MSA) is a nonparametric approach that offers exploratory tools for understanding the nature of item responses while emphasizing invariance requirements. MSA is often discussed as it relates to Rasch measurement theory, which also emphasizes invariance, but uses parametric models. Researchers who have compared and combined…

While traditional assessment models effectively evaluate student learning objectives within the classroom, they often fail to capture the extent to which students practice civic engagement, critical inquiry, and global citizenship following graduation. As educators, we often do not know whether students employ these concepts and embrace these…

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

In this Point of Departure, the idea of authentic assessment is examined and troubled by drawing on Derrida's hauntology. The spectres of higher education invite us to reconsider what is 'real' about past, present, and future assessment practices. Such spectres do not lecture or produce a single, definitive interpretation. Rather, these spectres…

Parallel analysis has been considered one of the most accurate methods for determining the number of factors in factor analysis. One major advantage of parallel analysis over traditional factor retention methods (e.g., Kaiser's rule) is that it addresses the sampling variability of eigenvalues obtained from the identity matrix, representing the…

The discipline of performance analysis is founded upon the collection and analysis of objective and reliable data to support the coaching process. While research has begun to identify the potential importance of trust in applied sporting environments, there remains a paucity of inquiry that seeks to explicitly investigate trustworthiness in the…

The author provides information about reliability and areas that educators should examine in determining if an assessment is consistent and trustworthy for use, and how it should be interpreted in making decisions about students. Reliability areas that are discussed in the column include internal consistency, test-retest or stability, inter-scorer…

In this article, I argue that we need to reposition how we think about and talk about assessment from a faculty-focused task to a student-centered process. To demonstrate the impact of this change in thinking, I will share a case study from my time as a basic course director and chair that illustrates the benefits of understanding assessment as a…