Data are an essential factor in the fourth industrial revolution, demanding engineers and scientists to leverage and analyze their potential for significantly improving the efficiency of industrial processes and their control systems. In classical industrial process control systems, the models are constructed using linear data-driven approaches,…

Simulations were conducted to establish best practice in hyperparameter optimization and accounting for clustering in Generalized Linear Mixed-Effects Model Trees (GLMM trees). Using data-driven best practices, the relationship between a 9th Grade On-Track to Graduate (9G-OTG) indicator and observed high school graduation within four years was…

Hierarchical data is often observed in education data. Analyzing such data with Multilevel Modeling becomes crucial to understanding the relationship at the individual and group levels. However, one of the most significant problems with this kind of data is small sample sizes and very low Intraclass Correlations. The multivariate Latent Covariate…

In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there…

The Q-matrix played a key role in implementations of diagnostic classification models (DCMs) or cognitive diagnostic models (CDMs) -- a family of psychometric models that are gaining attention in providing diagnostic information on students' mastery of cognitive attributes or skills. Using two Monte Carlo simulation studies, this dissertation…

Reliability indicates the internal consistency of a test. In educational studies, reliability is a key feature for a test. Researchers have proposed many traditional reliability estimates, such as coefficient alpha and coefficient omega. However, traditional reliability indices do not deal with the data hierarchy, even though the multilevel…

Young children are assessed to meet federal mandates and inform policy decisions, provide teachers with useful information to make instructional decisions and set reasonable learning goals, and facilitate communication with families. While young children are frequently assessed using whole-child assessments which often yield criterion-referenced…

We consider Bayesian estimation of a hierarchical linear model (HLM) from small sample sizes. The continuous response Y and covariates C are partially observed and assumed missing at random. With C having linear effects, the HLM may be efficiently estimated by available methods. When C includes cluster-level covariates having interactive or other…

One of the many impacts of the COVID-19 pandemic has been the increasing prevalence and accessibility of online education. This trend has also introduced challenges for students, instructors, and institutions. This study examines factors affecting online course satisfaction, focusing on individual, instructor, and institutional level…

This study introduces a longitudinal diagnostic classification model, called the LTA+HDCM, which is a fusion of latent transition analysis (LTA; Collins & Flaherty, 2002; Collins & Wugalter, 1992) and the hierarchical diagnostic classification model (HDCM; Templin & Bradshaw, 2014). The primary goals in this study are (1) to evaluate…

High stakes test-based accountability systems primarily rely on aggregates and derivatives of scores from tests that were originally developed to measure individual student mastery of content specifications. Current validity models do not explicitly address this use of aggregate scores to measure the performance of teachers, administrators, and…

Rambo-Hernandez and McCoach's analysis into the longitudinal growth of high-achieving students offered two conclusions about the reading growth of high achieving students: high-achieving students lose less ground in reading during the summer, but they exhibit less growth over the school year. This study will seek to replicate the reading results…

Many methods are used to measure interrater reliability for studies where each target receives ratings by a different set of judges. The purpose of this study is to explore the use of hierarchical modeling for estimating interrater reliability using the intraclass correlation coefficient. This study provides a description of how the ICC can be…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…

This study used a propensity score approach to estimate treatment effects in a multilevel setting. The propensity score approach involves the estimation of propensity scores for covariate balancing and the estimation of treatment effects. This study aimed at understanding how propensity scores estimated through a simple logistic regression compare…