Popular item response theory (IRT) models are considered complex, mainly due to the inclusion of a random factor variable (latent variable). The random factor variable represents the incidental parameter problem since the number of parameters increases when including data of new persons. Therefore, IRT models require a specific estimation method…

We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

A recent review found that 11% of published factor models are hierarchical models with second-order factors. However, dedicated recommendations for evaluating hierarchical model fit have yet to emerge. Traditional benchmarks like RMSEA <0.06 or CFI >0.95 are often consulted, but they were never intended to generalize to hierarchical models.…

When planning a cluster randomized trial, evaluators often have access to an enumerated cohort representing the target population of clusters. Practicalities of conducting the trial, such as the need to oversample clusters with certain characteristics in order to improve trial economy or support inferences about subgroups of clusters, may preclude…

The questionnaire method has always been an important research method in psychology. The increasing prevalence of multidimensional trait measures in psychological research has led researchers to use longer questionnaires. However, questionnaires that are too long will inevitably reduce the quality of the completed questionnaires and the efficiency…

This article presents the consensus of an National Council on Measurement in Education Presidential Task Force on Foundational Competencies in Educational Measurement. Foundational competencies are those that support future development of additional professional and disciplinary competencies. The authors develop a framework for foundational…

Children achieve better long-term language outcomes than adults. However, it remains unclear whether children actually learn language "more quickly" than adults during real-time exposure to input--indicative of true superior language learning abilities--or whether this advantage stems from other factors. To examine this issue, we…

The study aims to define the processes of pre-service mathematics teachers in reaching spatial visualisation generalisations within the context of drawing surface nets of solids. Two theories, Polya's problem-solving steps and novice-to-expert problem-solving schemas, were used as reference frameworks to describe the participants' spatial…

Background: Over 50% of individuals with aphasia face ongoing word-finding issues. Studies have found phonologically oriented therapy helpful for English speakers, but this has not yet been studied in French. It is essential to assess the effectiveness of such a therapy in French, considering the distinct linguistic typologies between both…

This study aims to understand individual differences between children in metacognitive monitoring and control processes and the developmental trajectories of metacognition over one year. Three indicators of procedural metacognition were used: monitoring accuracy (discrimination of confidence judgments between correct and incorrect test responses),…

The National Assessment of Educational Progress (NAEP) program only reports state-level subgroup results if it samples at least 62 students identifying with the subgroup. Since some subgroups constitute small proportions of many states' general student populations, these minority subgroups are seldom sufficiently sampled to meet this sample size…

The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…

Multidimensional item response theory (MIRT) models have generated increasing interest in the psychometrics literature. Efficient approaches for estimating MIRT models with dichotomous responses have been developed, but constructing an equally efficient and robust algorithm for polytomous models has received limited attention. To address this gap,…