Three articles in this special issue explore issues related to the use and misuse of statistical significance testing, the major methodological issue in current educational research. Comments on these articles and rejoinders by the authors of the first three articles explore additional aspects of statistical significance testing. (SLD)

Although statistical significance testing as the sole basis for result interpretation is a flawed practice, significance tests can be useful as one of three criteria that must be demonstrated to establish a position empirically. Statistical significance testing provides evidence that an event did not happen by chance but gives no evidence of the…

Expresses a "middle-of-the-road" position on statistical significance testing, suggesting that it has its place but that confidence intervals are generally more useful. Identifies 10 errors of omission or commission in the papers reviewed that weaken the positions taken in their discussions. (SLD)

Many evaluation students are still being taught the use of tests of statistical significance without being warned about their limitations. This paper discusses other estimates of treatment effects necessary to interpret between-group differences correctly. Sources to improve evaluation practice are also suggested. (SLD)

Suggests that replication research and meta-analysis are not substitutes for statistical significance testing, but rather, like measures of effect size, they are complements to statistical significance testing. Significance testing does provide a means for determining what might be usefully replicated. (SLD)

Proposes and illustrates a new method by which "what if" analyses can be conducted using estimated true population effects. Use of these "what if" methods may prevent authors with large sample sizes from overinterpreting their small effects once they see that the small effects would no longer have been statistically significant with only a…

Shows why the two-step approach proposed by D. Robinson and J. Levine (1997) is inappropriate for the evaluation of empirical results and reiterates the preferred approach of increased sample size and the computation of confidence intervals. (SLD)

Supports a two-step approach to the estimation and discussion of effect sizes, making a distinction between single-study decision-oriented research and multiple-study synthesis. Introduces and illustrates the concept of "conclusion coherence." (Author/SLD)

Many older adult have an interest in learning to use computers. The study reported in this article examined whether older adults' attitudes toward computers can be influenced by direct, customized computer training. Thirty older participants who registered for introductory computer courses offered at a SeniorNet computer lab completed the…

In order to determine the effects of gender and scholastic ability on vocabulary retention and reading comprehension in a foreign language, 181 men and women enrolled in a first-year Spanish course were asked to either read a passage in Spanish on a computer and create annotations for a list of words found in the passage (experimental group), or…

Discusses criticisms of null hypothesis significance testing (NHST), suggesting that historical use of NHST was reasonable, and current users should read Sir Ronald Fisher's applied work. Notes that modifications to NHST and interpretations of its outcomes might better suit the needs of modern science. Concludes that NHST is most often useful as…

This note shows that the dynamics of the dispersion of educational attainment across OECD countries in the period 1960-1990 differ enormously depending on the dataset used, as do the results of the test of significance in the change of the cross-country standard deviation of schooling years between subperiods. The three datasets studied (the…

Results after two years of using three reading comprehension curricula show gains from one program and no effects for the other two on reading comprehension for fifth-graders, according to a study released by the National Center for Education Evaluation and Regional Assistance in the Institute of Education Sciences. The study focused on whether…

The objective of this paper is to determine the extent to which business majors' attitudes towards globalization are influenced by the area of selected study. Research has documented that more favorable attitudes towards globalization are found among college students, and specifically, these more favorable attitudes are found in business majors.…

Several cognitive motivational scales were examined for their ability to predict short-range academic outcomes (grades, percentage of units earned over units attempted, units earned), and to measure cognitive gains as a consequence of services provided by community college counseling offices. The findings suggest that scales measuring…