Popular item response theory (IRT) models are considered complex, mainly due to the inclusion of a random factor variable (latent variable). The random factor variable represents the incidental parameter problem since the number of parameters increases when including data of new persons. Therefore, IRT models require a specific estimation method…

In this article, we systematically introduce the just another Gibbs sampler (JAGS) software program to fit common Bayesian cognitive diagnosis models (CDMs) including the deterministic inputs, noisy "and" gate model; the deterministic inputs, noisy "or" gate model; the linear logistic model; the reduced reparameterized unified…

Social networks in education commonly involve some form of grouping, such as friendship cliques or teacher departments, and blockmodels are a type of statistical social network model that accommodate these grouping or blocks by assuming different within-group tie probabilities than between-group tie probabilities. We describe a class of models,…

Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

The literature on teachers' unions is relatively silent about the role of union strength in affecting important outcomes, due in large part to the difficulty in measuring union strength. In this article, we illustrate a method for obtaining valid, reliable, and replicable measures of union strength through the use of a Partial Independence Item…

When studying educational aspirations of adolescents, it is unrealistic to assume that the aspirations of pupils are independent of those of their friends. Considerable attention has also been given to the study of peer influence in the educational and behavioral literature. Typically, in empirical studies, the friendship networks have either been…

For RCTs of education interventions, it is often of interest to estimate associations between student and mediating teacher practice outcomes, to examine the extent to which the study's conceptual model is supported by the data, and to identify specific mediators that are most associated with student learning. This article develops statistical…

In this article, we discuss the effect of removing the independence assumptions between the residuals in two-level random effect models. We first consider removing the independence between the Level 2 residuals and instead assume that the vector of all residuals at the cluster level follows a general multivariate normal distribution. We…

When the errors in an ordinary least squares (OLS) regression model are heteroscedastic, hypothesis tests involving the regression coefficients can have Type I error rates that are far from the nominal significance level. Asymptotically, this problem can be rectified with the use of a heteroscedasticity-consistent covariance matrix (HCCM)…

Standardized effect sizes and confidence intervals thereof are extremely useful devices for comparing results across different studies using scales with incommensurable units. However, exact confidence intervals for standardized effect sizes can usually be obtained only via iterative estimation procedures. The present article summarizes several…

This article presents a technique that will help teachers, researchers, and other people who use the linear regression models, especially those in education and social sciences, to understand and interpret the residuals graphics better.

Describes available variance component tests and presents three new score tests. One test uses the asymptotic normal distribution of the test statistic as a reference distribution; the others use a Satterthwaite approximation for the null distribution of the test statistic. Evaluates the performance of these tests through Monte Carlo simulation.…

A simple errors-in-variables regression model is given in this article for illustrating the method of marginal maximum likelihood (MML). Given suitable estimates of reliability, error variables, as nuisance variables, can be integrated out of likelihood equations. Given the closed form expression of the resulting marginal likelihood, the effects…

Examines the ways in which level-1 outliers can impact the estimation of fixed effects and random effects in hierarchical models (HMs). Also outlines and illustrates the use of Markov Chain Monte Carlo algorithms for conducting sensitivity analyses under "t" level-1 assumptions, including algorithms for settings in which the degrees of…

When constructed response test items are scored by more than one rater, the repeated ratings allow for the consideration of individual rater bias and variability in estimating student proficiency. Several hierarchical models based on item response theory have been introduced to model such effects. In this article, the authors demonstrate how these…