Purpose: Predictions are complex, multisensory, and dynamic processes involving real-time adjustments based on environmental inputs. Disruptions to prediction abilities have been proposed to underlie characteristics associated with autism. While there is substantial empirical literature related to prediction, the field lacks a self-assessment…

Long-running surveys need a systematic way to reflect social change and to keep items relevant to respondents, especially when they ask about controversial subjects, or they threaten the items' validity. We propose a protocol for updating measures that preserves content and construct validity. First, substantive experts articulate the current and…

Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends…

Background: For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Recent investigations on how people derive meaning from language have focused on task-dependent shifts between two cognitive systems. The symbolic (amodal) system represents meaning as the statistical relationships between words. The embodied (modal) system represents meaning through neurocognitive simulation of perceptual or sensorimotor systems…

Learning affective state is determinate to online learning. Different affective states are associated with different online learning behaviors. Given the behavioral indicators of different affective states are still to be explored, this study constructed a data-driven online learning affective state detector by analyzing the learning log data of…

Background: The study focuses on the need to optimise assessment scales for support needs in individuals with intellectual and developmental disabilities. Current scales are often lengthy and redundant, leading to exhaustion and response burden. The goal is to use machine learning techniques, specifically item-reduction methods and selection…

Data from a moderately-selective state university in the Midwest is used to cross-examine the most appropriate data analytical techniques for predicting versus explaining college student persistence decisions. The current research provides an overview of the relative benefits of models specializing in prediction versus explanation with particular…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a…

The way we measure values is foundational to their study. This paper explores the empirical findings and theoretical discussions in the literature concerning an essential quality for any measure of values, its validity. We discuss an important debate on validity within the literature concerning the ability of value measures to predict…

Background: Professor-student rapport is associated with various important student success outcomes, highlighting the need for a good measure of this construct. Objective: The current study attempted to replicate the components of the Professor-Student Rapport Scale (PSRS) reported in Wilson and Ryan (2013). Method: 760 undergraduate students…

This study examines the predictive validity of high school grade point average and ACT® Composite score on first-year college grade point average prior to and after the onset of the COVID-19 pandemic in 2020. The findings reveal that the predictive power of high school grade point average changed significantly after 2020, suggesting that students…

Understanding the response process used by test takers when responding to multiple-choice questions (MCQs) is particularly important in evaluating the validity of score interpretations. Previous authors have recommended eye-tracking technology as a useful approach for collecting data on the processes test taker's use to respond to test questions.…