In operational testing, item response theory (IRT) models for dichotomous responses are popular for measuring a single latent construct [theta], such as cognitive ability in a content domain. Estimates of [theta], also called IRT scores or [theta hat], can be computed using estimators based on the likelihood function, such as maximum likelihood…

Purpose: The aim of this study was to assess the effect of eight different facemasks on speech perception and listening effort in listeners with normal hearing (NH) and hearing loss by manipulating both mask type and background noise levels. Method: Forty adults listened to Quick Speech-in-Noise Test sentences recorded by a female talker through…

Coefficient alpha reliability persists as the most common reliability coefficient reported in research. The assumptions for its use are, however, not well-understood. The current paper challenges the commonly used expressions of coefficient alpha and argues that while these expressions are correct when estimating reliability for summed scores,…

This study uses two annual cohorts of students from a large, public, midwestern research institution to implement a propensity-based analysis of a student support program called Supplemental Instruction. Beginning with the history and importance of improving college completion (i.e. graduation) rates, this study identifies student support…

The current study aims to evaluate the performance of three non-IRT procedures (i.e., normal approximation, Livingston-Lewis, and compound multinomial) for estimating classification indices when the observed score distribution shows atypical patterns: (a) bimodality, (b) structural (i.e., systematic) bumpiness, or (c) structural zeros (i.e., no…

In this digital ITEMS module, Dr. Michael Bunch provides an in-depth, step-by-step look at how standard setting is done. It does not focus on any specific procedure or methodology (e.g., modified Angoff, bookmark, and body of work) but on the practical tasks that must be completed for any standard setting activity. Dr. Bunch carries the…

Measuring teacher effectiveness has been debated and studied for numerous years. While some progress has been made, consensus has yet to be reached regarding what it means to be an effective teacher and how to measure effectiveness. This study uses administrative data from North Carolina to assess the relationship between school principal…

Considering the interdisciplinary nature of the sustainable development concept, this study aims to investigate the effect of a cross-curricular mathematical modeling course on pre-service teachers' sustainable development attitudes and mathematical modeling self-efficacies and to investigate their opinions about the course. The sample for this…

This action research aims to develop the ability to solve mathematical problems, particularly in polygons, through open-approach learning management for sixth-grade students, with the goal of achieving an average score exceeding 70% of the total possible score. The target group consisted of eight students in the second semester of the academic…

This study investigated the effect of the motor game 'Exchequer Motor Game' (EMG) on first-grade children's Level of Geometric Thinking (LGT) and their post-learning mood tracking (PLMT). Thirty children (age 6.1 ± 0.7 years; physical education experience: 0.6 ± 0.4 years), classified at the "Visualization" stage of van Hiele's geometric…

The purpose of this study was to compare the effectiveness of interdependent and independent group contingencies on pre-service teachers' performance on class quizzes that reflected their knowledge of evidence-based practices for students with extensive support needs. In the interdependent condition, the course instructor awarded extra credit…

When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

Research shows that third-grade reading proficiency is the most significant predictor of future success, including graduation rates, earning potential, crime, and health. Mastery of foundational literacy skills during preschool bolsters students' ability to learn to read before fourth grade when the transition from learning to read to reading to…

We develop a "latent variable forest" (LV Forest) algorithm for the estimation of latent variable scores with one or more latent variables. LV Forest estimates unbiased latent variable scores based on "confirmatory factor analysis" (CFA) models with ordinal and/or numerical response variables. Through parametric model…

In this study, we introduced a cross-classified multidimensional nominal response model (CC-MNRM) to account for various response styles (RS) in the presence of cross-classified data. The proposed model allows slopes to vary across items and can explore impacts of observed covariates on latent constructs. We applied a recently developed variant of…