Estimating confidence intervals (CIs) for the correlation has been a challenge because the correlation sampling distribution changes depending on the correlation magnitude. The Fisher z-transformation was one of the first attempts at estimating correlation CIs but has historically shown to not have acceptable coverage probability if data were…

The "Borel" board game consists of a series of experiments involving dice rolls, coin flips, or drawing colored balls from bags. Before each experiment is conducted, each player bets for or bets against a statement regarding the random outcome. We suggest that the collection of "Borel" experiments be used as a resource to…

Students are typically introduced to probability through calculating simple events like flipping a coin. While these calculations can be done by hand, more complex probabilistic events, both in class and in the real world, require the use of computers. In this paper, we introduce a new tool--an R shiny web app and associated CRAN package based on…

We consider two-level models where a continuous response R and continuous covariates C are assumed missing at random. Inferences based on maximum likelihood or Bayes are routinely made by estimating their joint normal distribution from observed data R[subscript obs] and C[subscript obs]. However, if the model for R given C includes random…

This study examined the use of Bayesian analysis methods for the estimation of item parameters in a two-parameter logistic item response theory model. Using simulated data under various design conditions with both informative and non-informative priors, the parameter recovery of Bayesian analysis methods were examined. Overall results showed that…

The Monte Carlo method is one of the basic simulation statistical methods which can be used both to demonstrate basic probability and statistical concepts as well as to analyse the behaviour stochastic models. The introduction part of the article provides a brief description of the Monte Carlo method. The main part of the article is concentrated…

Diagnostic classification models (DCMs, also known as cognitive diagnosis models) hold the promise of providing detailed classroom information about the skills a student has or has not mastered. Specifically, DCMs are special cases of constrained latent class models where classes are defined based on mastery/nonmastery of a set of attributes (or…

The Monte Carlo method and related multiple imputation methods are traditionally used in math, physics and science to estimate and analyze data and are now becoming standard tools in analyzing business and financial problems. However, few sources explain the application of the Monte Carlo method for individuals and business professionals who are…

Policymakers have grown increasingly interested in how experimental results may generalize to a larger population. However, recently developed propensity score-based methods are limited by small sample sizes, where the experimental study is generalized to a population that is at least 20 times larger. This is particularly problematic for methods…

Policymakers are increasingly interested in the extent to which experimental results generalize from a sample to a population of inference. When the sample is not randomly selected, propensity score methods are used to reweight the sample. Subclassification by propensity score is commonly used in which the population is partitioned into strata…

In recent years, there has been increasing focus on the issue of multiple hypotheses testing in education evaluation studies. In these studies, researchers are typically interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time or across multiple treatment groups. When…

Despite the popularity of propensity score (PS) techniques they are not yet well studied for matching multilevel data where selection into treatment takes place among level-one units within clusters. This paper suggests a PS matching strategy that tries to avoid the disadvantages of within- and across-cluster matching. The idea is to first…

Randomized experiments are considered the gold standard for causal inference because they can provide unbiased estimates of treatment effects for the experimental participants. However, researchers and policymakers are often interested in using a specific experiment to inform decisions about other target populations. In education research,…

Partially compensatory models may capture the cognitive skills needed to answer test items more realistically than compensatory models, but estimating the model parameters may be a challenge. Data were simulated to follow two different partially compensatory models, a model with an interaction term and a product model. The model parameters were…

We present a logistic function of a monotonic polynomial with a lower asymptote, allowing additional flexibility beyond the three-parameter logistic model. We develop a maximum marginal likelihood based approach to estimate the item parameters. The new item response model is demonstrated on math assessment data from a state, and a computationally…