Examines the influence of statistical significance on reviewers' recommendations for the acceptance or rejection of a manuscript for publication. Discusses the concept of power and the importance of effect size in the evaluation of research findings. (WAS)

An analytic procedure is presented which casts sequential moderator analysis in the role of a multivariate test of parallelism of regressions. The procedure addresses a test for comparing predictor-criterion relationships for one set of measurements or multiple predictors and repeated measurements on a criterion. (Author/PN)

Consulting editors (N=101) of the Journal of Counseling Psychology and the Journal of Consulting and Clinical Psychology evaluated three versions, differing only with regard to level of statistical significance, of a research manuscript. Statistically nonsignificant and approach significance versions were more likely to be recommended for…

Formulas for estimating the population measure of effect strength are based on the assumption that sample sizes are proportional to the sizes of their respective treatment populations. Because this assumption is frequently violated, a general method of estimating effect strength for the one-factor, fixed-effects design is presented. (Author/BW)

Discusses (1) the use of chi square significance tests in social science and educational literature; (2) chi square in relation to sample size; (3) field difficulties with chi square analysis as exemplified in Milwaukee County Juvenile Court data; and (4) alternative methods for using chi square in field research. (Author/GC)

Regions of significance in aptitude-by-treatment-interaction studies are examined by the traditional statistical approach and an alternative approach which integrates: (1) testing for the parallelism of two or more regression lines; (2) testing for their identity; and (3) Scheffe's theorem. (Author/RL)

Two alternative procedures are described for testing the significance of differences of group means. The first consists of a reduction in the critical value when comparing the largest and smallest means. The other alternative uses the unmodified range test without a preliminary F test. An example is provided. (Author/CTM)

A new coefficient--psi-star--is presented for measuring agreement on bidirectional response continua. The coefficient is designed to measure agreement in larger square contingency tables with even numbers of rows and columns. Advantages of the procedure are discussed. (SLD)

Simulation studies were used to explore the relationship between Type I error rates (statistical conclusion validity) and multiple testing in data sets exhibiting varying degrees of independence. Implications for reporting and interpreting educational data are discussed, and methods of determining or reducing Type I error incidence are presented.…

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)

The analysis of contingency tables via set correlation allows the assessment of subhypotheses involving contrast functions of the categories of the nominal scales. The robustness of such methods with regard to Type I error and statistical power was studied via a Monte Carlo experiment. (TJH)

Performances of the Mantel Haenszel odds-ratio estimator and chi-square significance test were investigated using simulated data for 500 reference group and 500 focal group examinees. Results demonstrate the importance of using both the odds-ratio and significance tests in interpreting the presence or absence of differential item functioning. (SLD)

A previous paper proposed a generalized family of coefficients of relational agreement for multiple judges. It focused on the concept of empirically meaningful relationships. This paper presents an ordinal coefficient of relational agreement as a special case of the generalized family. The proposed ordinal coefficient encompasses other ordinal…

Results of a Monte Carlo study with 4 populations (3,072 conditions) indicate that when distributions depart markedly from normality, nonparametric analysis and parametric analysis of transformed data show superior power to parametric analysis of raw data. Under conditions studied, parametric analysis of transformed data is more powerful than…

A computer simulation compared significance tests of correlation coefficients calculated from initial scores, from ranks assigned by the Spearman method, and from three kinds of modified ranks. Implications of findings for the idea that rank correlation is a nonparametric correlation method are discussed. (SLD)