Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

Growth mixture models (GMMs) are a popular method to identify latent classes of growth trajectories. One shortcoming of GMMs is nonconvergence, which often leads researchers to apply covariance equality constraints to simplify estimation, though this may be a dubious assumption. Alternative model specifications have been proposed to reduce…

Assessing student achievement over multiple years is complicated by students' annual matriculation through different classrooms. The process of matriculation, or annual classroom change, threatens the validity of statistical inferences because it violates the independence of observations necessary in a regression context. The current study…

Purpose: Higher education curriculum development in the construction industry has historically received scant academic attention and often, courses/programmes are largely developed using the tacit knowledge of individual tutors. This research investigates the core interpersonal and technical skills and competencies required of a contemporary…

Multidimensionality and hierarchical data structure are common in assessment data. These design features, if not accounted for, can threaten the validity of the results and inferences generated from factor analysis, a method frequently employed to assess test dimensionality. In this article, we describe and demonstrate the application of the…

Text is a burgeoning data source for psychological researchers, but little methodological research has focused on adapting popular modeling approaches for text to the context of psychological research. One popular measurement model for text, topic modeling, uses a latent mixture model to represent topics underlying a body of documents. Recently,…

Practitioners of adult education have a long history of teaching for social change. They may, however, be uncomfortable using quantitative methods to assess the impact of their learning activities, or they might lack access to statistical analysis software. Quantitative methods help the practitioner determine whether behavioral or attitudinal…

Measurement of latent constructs is one of the most challenging tasks in psychological research. Unlike physical variables, latent constructs are not directly observable but are inferred through individuals' responses to a set of items often referred to as measurement instruments, tests, surveys, or assessments. For decades, exploratory factor…

Completion of remedial mathematics has been identified as one of the keys to college success. However, completion rates in remedial mathematics have been low and are of much debate across America. This study leverages machine learning techniques in trying to predict and understand completion rates in remedial mathematics. The purpose of this study…

The present study describes an R function that implements six corrective procedures developed by Bartlett, Swain, and Yuan in the correction of 21 statistics associated with the omnibus Chi-square test, the residuals, or fit indices in confirmatory factor analysis (CFA) and structural equation modeling (SEM).

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

In cognitive diagnostic assessment, multiple fine-grained attributes are measured simultaneously. Attribute hierarchies are considered important structural features of cognitive diagnostic models (CDMs) that provide useful information about the nature of attributes. Templin and Bradshaw first introduced a hierarchical diagnostic classification…

Nonlinear mixed-effects models are models in which one or more coefficients of the growth model enter in a nonlinear manner, such as appearing in the exponent of the growth function. In their applications, the within-individual residuals are often assumed to be independent with constant variance across time, an assumption that implies that the…

This article introduces the concept of the carrying capacity of data (CCD), defined as an integrated, evaluative judgment of the credibility of specific data-based inferences, informed by quantitative and qualitative analyses, leavened by experience. The sequential process of evaluating the CCD is represented schematically by a framework that can…

It is not always clear how to adjust for control data in causal inference, balancing the goals of reducing bias and variance. We show how, in a setting with repeated experiments, Bayesian hierarchical modeling yields an adaptive procedure that uses the data to determine how much adjustment to perform. The result is a novel analysis with increased…