This dissertation used synthetic datasets, semi-synthetic datasets, and a real-world dataset from an educational intervention to compare the performance of 15 machine learning and multiple imputation methods to estimate the individual treatment effect (ITE). In addition, it examined the performance of five evaluation metrics that can be used to…

Rater comparison analysis is commonly necessary in the social sciences. Conventional approaches to the problem generally focus on calculation of agreement statistics, which provide useful but incomplete information about rater agreement. Importantly, one-number agreement statistics give no indication regarding the nature of disagreements, nor do…

Recently, Bayesian diagnostic classification modeling has been becoming popular in health psychology, education, and sociology. Typically information criteria are used for model selection when researchers want to choose the best model among alternative models. In Bayesian estimation, posterior predictive checking is a flexible Bayesian model…

Multivariate count data is ubiquitous in many areas of research including the physical, biological, and social sciences. These data are traditionally modeled with the Dirichlet Multinomial distribution (DM). A new, more flexible Dirichlet-Tree Multinomial (DTM) model is gaining in popularity. Here, we consider Bayesian DTM regression models. Our…

Bayesian network is a probabilistic graphical model that has wide applications in various domains due to its peculiarity of knowledge representation and reasoning under uncertainty. This research aims at Bayesian network structure learning and how the learned model can be used for reasoning. Learning the structure of Bayesian network from data is…

This dissertation is a collection of three papers. The first is a conceptual paper, followed by two data analysis papers. All three papers examine the connection between structural equation models and regression models, and how one may better learn, research and apply structural equation models when structural equation models are thought of as…

Spatio-temporal processes are ubiquitous and prevalent across disciplines. Understanding the mechanisms underlying processes and integrating this information into models is of great interest, as it can improve forecasting accuracy and align with scientific motivation. Examples of such models include Partial Differential Equation (PDE) Models or…

This thesis studies four independent resource allocation problems with different assumptions on information available to the central planner, and strategic considerations of the agents present in the system. We start off with an online, non-strategic agents setting in Chapter 1, where we study the dynamic pricing and learning problem under the…

We study flexible Bayesian methods that are amenable to a wide range of learning problems involving complex high dimensional data structures, with minimal tuning. We consider parametric and semiparametric Bayesian models, that are applicable to both static and dynamic data, arising from a multitude of areas such as economics, finance and…

I study the impact of novel game manipulations on user engagement using principled computational methods. Maximizing user engagement is important because it results in more profitable games in the commercial arena and better learning outcomes in the educational arena. It is then perhaps unsurprising that the study of user engagement is well…

Evidence of student growth is a primary outcome of interest for educational accountability systems. When three or more years of student test data are available, questions around how students grow and what their predicted growth is can be answered. Given that test scores contain measurement error, this error should be considered in growth and…

Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

Research in education has become increasingly reliant on statistical modeling frameworks to be reflective of the subject matter, to accurately assess what students know and can do, to assist instructors with curriculum design by supplementing informative feedback, and to support policy-makers when making evidence-based decisions. A common feature…

Student misconceptions have been studied for decades from a curricular/instructional perspective and from the assessment/test level perspective. Numerous misconception assessment tools have been developed in order to measure students' misconceptions relative to the correct content. Often, these tools are used to make a variety of educational…

Many important real-world decision-making problems involve group interactions among individuals with purely informational interactions. Such situations arise for example in jury deliberations, expert committees, medical diagnoses, etc. We model the purely informational interactions of group members, where they receive private information and act…