Although hypothesis testing is ubiquitous in data analysis, research suggests it is commonly misunderstood. Simulation-based inference methods have potential to make student thinking visible, thus providing a valuable lens to analyze developing conceptions about inference. This paper identifies difficulties made visible through simulation-based…

This paper presents a case study of students (age 14-15) as they attempt to make sense of distribution, adopting a range of causal meanings for the variation observed in the animated computer display and in the graphs generated by a "BasketBall" simulation. The student activity is analysed through dimensions of complex causality. The…

The study explores the development of 11-year-old students' informal inference about random bunny hops through student talk and use of computer simulation tools. Our aim in this paper is to draw on dialogic theory to explain how students make shifts in perspective, from intuition-based reasoning to more powerful, formal ways of using probabilistic…

This study was an investigation of the relation between the reliability of difference scores, considered as a parameter characterizing a population of examinees, and the reliability estimates obtained from random samples from the population. The parameters in familiar equations for the reliability of difference scores were redefined in such a way…

Computer-based multimedia presentations employing animated agents (avatars) can positively impact perceptions about engineering; the current research advances our understanding of this effect to pre-college populations, the main target for engineering outreach. The study examines the effectiveness of a brief computer-based intervention with…

The present investigation developed power curves for two parametric and two nonparametric procedures for testing the equality of population variances. Both normal and non-normal distributions were considered for the two group design with equal and unequal sample frequencies. The results indicated that when population distributions differed only in…

This paper presents a summary of action research investigating statistics students' understandings of the sampling distribution of the mean. With four sections of an introductory Statistics in Education course (n=98 students), a computer simulation activity (R. delMas, J. Garfield, and B. Chance, 1999) was implemented and evaluated to show…

This study examined the sampling distribution of the analysis of variance F ratio in the two sample cases when it followed a preliminary test for variance equality. When the population variances were equal, the sampling distribution approximated the theoretical F distribution quite well, but not when population variances differed. (JAZ)

Using computer simulation, parametric analysis of covariance (ANCOVA) was compared to ANCOVA with data transformed using ranks, in terms of proportion of Type I errors and statistical power. Results indicated that parametric ANCOVA was robust to violations of either normality or homoscedasticity, but practiced significant power differences favored…

This study investigated the distributional properties of the standardized residual that is commonly used in the Rasch model calibration program to develop various indices of item and person fit. The power of the standardized residual to detect measurement disturbances is also addressed. (TJH)

Under the assumptions of classical measurement theory and the condition of normality, a formula is derived for the reliability of composite scores. The formula represents an extension of the Spearman-Brown formula to the case of truncated data. (Author/JAZ)

A Monte Carlo study was done to determine the adequate sample size for quasi-experimental regression studies, which compare regression lines for two groups and estimate their point of intersection. Populations of 1,000 subjects in each of two groups were constructed (using random normal deviates) to yield equivalent regression lines of opposite…

This study investigated the robustness of the James second-order test (James 1951; Wilcox, 1989) and the univariate F test under a two-factor fixed-effect analysis of variance (ANOVA) model in which cell variances were heterogeneous and/or distributions were nonnormal. With computer-simulated data, Type I error rates and statistical power for the…

This paper examined the rank transformation approach to analysis of variance as a solution to the Behrens-Fisher problem. Using simulation methodology four parameters were manipulated for the two group design: (1) ratio of population variances; (2) distribution form; (3) sample size and (4) population mean difference. The results indicated that…

This paper investigates three methods for comparing medians rather than means in studying two independent treatment groups. The method that gave the best results is based on a normal approximation of the distribution of the sample median where the variance is estimated using results reported by Maritz and Jarrett. (Author/JAZ)