Classical item analysis (CIA) entails summarizing items based on two key attributes: item difficulty and item discrimination, defined as the proportion of examinees answering correctly and the difference in correctness between high and low scorers. Recent insights reveal a direct link between these measures and aspects of signal detection theory…

In conducting confirmatory factor analysis with ordered response items, the literature suggests that when the number of responses is five and item skewness (IS) is approximately normal, researchers can employ maximum likelihood with robust standard errors (MLR). However, MLR can yield biased factor loadings (FL) and FL standard errors (FLSE) when…

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item…

The purpose of the study was to investigate secondary choral music educators' and administrators' perceptions of the use of the Mississippi Professional Growth System (PGS) as an applicable tool for evaluating secondary choral music educators. While there is limited research regarding the evaluation of choral music educators, this study aimed to…

The purpose of this study was to investigate the effectiveness of four different models (bifactor, CTC(M-1), CTCU and unidimensional) as to optimal model selection when the wording effect associated with negatively worded items was present. A Monte Carlo simulation study was conducted to compare model-data fit and accuracy in parameter estimates…

This paper seeks to empirically validate a sector agonistic instrument that measures the perceived critical success factors in data governance. Twelve constructs (Leadership and Management Commitment; Leadership and Management Alignment; Executive Sponsorship; Robust Data Governance Strategy; Change Management; Training and Education; Governance…

This study addresses the underexplored terrain of conceptualizing and operationalizing race and ethnicity as grouping variables in Differential Item Functioning (DIF) studies within the context of psychometric research. The investigation extends beyond the identification of DIF and delves into the theoretical framing and communication of findings…

Recent advancements in testing differential item functioning (DIF) have greatly relaxed restrictions made by the conventional multiple group item response theory (IRT) model with respect to the number of grouping variables and the assumption of predefined DIF-free anchor items. The application of the L[subscript 1] penalty in DIF detection has…

Because non-cognitive constructs can influence student success in education beyond academic achievement, it is essential that they are reliably conceptualized and measured. Within this context, there are several gaps in the literature related to correctly interpreting the meaning of scale scores when a non-standard response option like I do not…

It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the "degree to which test scores are…

This three-article dissertation aims to address three methodological challenges to ensure comparability in educational research, including scale linking, test equating, and propensity score (PS) weighting. The first study intends to improve test scale comparability by evaluating the effect of six missing data handling approaches, including…

Over the past few decades, physics education researchers (PER) developed a variety of assessments instrument for research and instructional purposes. Most of these instruments are designed to measure topical understanding. Generally, if student performance is satisfactory, it is assumed that the students possess the content understanding and that…

We study how to automatically generate cloze questions from given texts to assess reading comprehension, where a cloze question consists of a stem with a blank space holder for the answer key, and three distractors for generating confusions. We present a generative method called CQG (Cloze Question Generator) for constructing cloze questions from…

This study served as an initial investigation into necessary components of successful mentorship at the doctoral level within Counselor Education and Supervision (CES). This study utilized Q methodology to explore the perceptions of thirteen doctoral students who identified as having a CES faculty mentor. Mentorship is a vital component of…

This convergent, parallel, mixed-methods study with qualitative and quantitative content analysis methods was conducted to identify what type of thinking is required by the College and Career Readiness Assessment (CCRA+) by (a) determining the frequency and percentage of questions categorized as higher-level thinking within each cell of Hess'…