The sampling distribution is a common source of misuse and misunderstanding in the study of statistics. The sampling distribution, underlying distribution, and the Central Limit Theorem are all interconnected in defining and explaining the proper use of the sampling distribution of various statistics. The sampling distribution of a statistic is…

This paper explains the underlying assumptions of the sampling distribution and its role in significance testing. To compute statistical significance, estimates of population parameters must be obtained so that only one sampling distribution is defined. A sampling distribution is the underlying distribution of a statistic. Sampling distributions…

It is suggested that using an unbiased estimate of the weight matrix may eliminate the small or intermediate sample size bias of the asymptotically distribution-free (ADF) test statistic. Results of simulations show that test statistics based on the biased estimator or the unbiased estimate are highly similar. (SLD)

Randomized response measurement techniques have been proposed to overcome subject unwillingness to answer embarrassing or threatening questions truthfully. Many of the applications to date have dealt with health-related issues. This article demonstrates the application of the unrelated question randomized response design with one such question.…

Investigates the BILOG computer program's ability to recover known item parameters for different numbers of items, examinees, and variances of the prior distributions of discrimination parameters for the two-parameter logistic item-response theory model. For samples of at least 250 examinees and 15 items, simulation results support using BILOG.…

Asymptotic distributions of H. Brogden's and F. Lord's modified sample biserial correlation coefficients (SBCCs) are derived. Asymptotic variances of these estimators are evaluated for bivariate normal populations and compared to the maximum likelihood estimator's asymptotic variance. These estimators are less variable than ordinary SBCCs when the…

The accuracy of estimation procedures in item response theory was studied using Monte Carlo methods and varying sample size, number of subjects, and distribution of ability parameters for: (1) joint maximum likelihood as implemented in the computer program LOGIST; (2) marginal maximum likelihood; and (3) marginal Bayesian procedures as implemented…

The L statistic of E. B. Page (1963) tests the agreement of a single group of judges with an a priori ordering of alternative treatments. This paper extends the two group test of D. W. Leitner and C. M. Dayton (1976), an extension of the L test, to analyze difference in consensus between two unequally sized groups of judges. Exact critical values…

This study was designed to compare the accuracy of three commonly used ability estimation procedures under the graded response model. The three methods, maximum likelihood (ML), expected a posteriori (EAP), and maximum a posteriori (MAP), were compared using a recovery study design for two sample sizes, two underlying ability distributions, and…

A Monte Carlo study was done to determine the adequate sample size for quasi-experimental regression studies, which compare regression lines for two groups and estimate their point of intersection. Populations of 1,000 subjects in each of two groups were constructed (using random normal deviates) to yield equivalent regression lines of opposite…

The observed probability "p" is the social scientist's primary tool for evaluating the outcome of statistical hypothesis tests. The small-sample accuracy of nonnull asymptotic distributions of several functions of "p" was studied. Implications for use of the approximations are discussed. (SLD)

Modifications are proposed to the recently developed method of comparing one-step M-estimators of location corresponding to two independent groups that provides good control over the probability of Type I error even for unequal sample size, unequal variances, and different shaped distributions. Simulation results reveal cautions required. (SLD)

The extent to which log-linear smoothing could improve the accuracy of common-item equating by the chained equipercentile method in small samples of examinees was investigated with responses from a 100-item test and 93,283 examinees. Smoothing reduced the sample size required for a given degree of accuracy. (SLD)

Power and Type I error rates were estimated for contingency tables with small sample sizes for the following four types of tests: (1) Pearson's chi-square; (2) chi-square with Yates's continuity correction; (3) the likelihood ratio test; and (4) Fisher's Exact Test. Various marginal distributions, sample sizes, and effect sizes were examined. (SLD)

This paper describes a study, now in progress, of new methods for representing the sampling variability of Mantel-Haenszel differential item functioning (DIF) results, based on the system for categorizing the severity of DIF that is now in place at the Educational Testing Service. The methods, which involve a Bayesian elaboration of procedures…