The purpose of this paper is to demonstrate in detail how the Empirical Bayes (EB) statistical estimation strategy can be applied to an important class of educational research contexts. EB methods are tailored specifically to the analysis of data with a hierarchical structure. For instance, investigators may be interested in discovering how…

Estimation theory in educational statistics and the application of hierarchical linear models are reviewed. Observations within each group vary as a function of microparameters. Microparameters vary across the population of groups as a function of macroparameters. Bayes and empirical Bayes viewpoints review examples with two levels of hierarchy.…

It is shown that Bayesian algorithms are computationally simpler in frequency formats than in the probability formats used in previous research. Analysis of several thousand solutions to Bayesian problems showed that when information was presented in frequency formats, statistically naive participants derived up to 50% of inferences by Bayesian…

A proportional reduction in loss (PRL) measure for reliability of categorical data is explored for the situation in which each of "N" judges assigns a subject to one of "K" categories. Calculating a lower bound for reliability under more general conditions than had been proposed is demonstrated. (SLD)

An approximation procedure is proposed for the posterior means and standard deviation of the ability parameter in an item response model. The method is illustrated for the two-parameter logistic model using data from a 39-item American College Testing mathematics test. The effect of sample size is considered. (SLD)

Simultaneous estimation of many parameters can often be improved, sometimes dramatically so, if it is reasonable to consider one or more subsets of parameters as exchangeable members of corresponding populations. While each observation may provide limited information about the parameters it is modeled directly in terms of, it also contributes…

Four researchers at the Educational Testing Service describe what they consider some of the most vexing research problems they face. While these problems are not completely statistical, they all have major statistical components. Following the introduction (section 1), in section 2, "Problems with the Simultaneous Estimation of Many True…