Testing Theory-based Quantitative Predictions (TTQP) represents an alternative to traditional Null Hypothesis Significance Testing (NHST) procedures and is more appropriate for theory testing. The theory generates explicit effect size predictions and these effect size estimates, with related confidence intervals, are used to test the predictions.…

Researchers are strongly encouraged to accompany the results of statistical tests with appropriate estimates of effect size. For 2-group comparisons, a probability-based effect size estimator ("A") has many appealing properties (e.g., it is easy to understand, robust to violations of parametric assumptions, insensitive to outliers). We review…

A previous Monte Carlo study examined the relative powers of several simple and more complex procedures for testing the significance of difference in mean rates of change in a controlled, longitudinal, treatment evaluation study. Results revealed that the relative powers depended on the correlation structure of the simulated repeated measurements.…

Order analysis, a technique to isolate unidimensional hierarchies representing multidimensional structure of binary data, is reviewed. Several theoretical flaws inherent in the probalistic version are presented. Suggestions of possible directions for future research are offered. (Author)

The procedures yielding confidence intervals for maximized alpha coefficients of Joe and Woodward are reviewed. Confidence interval procedures of Whalen and Masson are next reviewed. Results are then presented of a Monte Carlo investigation of the procedures. (Author/CTM)

Cattell's scree test and Bartlett's chi-square test for the number of factors to be retained from a factor analysis are shown to be based on the same rationale, with the former reflecting subject sampling variability, and the latter reflecting variable sampling variability. (Author/JKS)

The need for multiple comparison procedures for repeated measures means employing a pooled estimate of error variance to conform to the sphericity assumptions of the design in order to provide a valid test is discussed. An alternative approach which does not require this assumption is presented. (Author/JKS)

The strategy for investigating convergent and discriminant test validity, known as the multitrait-multimethod matrix, is investigated. A nonparametric significance testing procedure is suggested and demonstrated. (JKS)

This paper considers the case of two predictor variables. Figures are obtained which show the regions of significance of joint regression coefficients, regression coefficients considered separately, and the multiple correlation. The intersection of these regions of significance and non-significance illustrates how the various apparent…

The partitioned-U procedure is outlined, a fundamental logical flaw in this procedure's avoidance of any direct test of the significance of the first discriminant function or largest coefficient of canonical correlation is pointed out, and two alternatives to the partitioned-U procedure are discussed. (Author/DEP)

The analysis of contingency tables via set correlation allows the assessment of subhypotheses involving contrast functions of the categories of the nominal scales. The robustness of such methods with regard to Type I error and statistical power was studied via a Monte Carlo experiment. (TJH)

Five methods for testing the hypothesis of independence between two sets of variates were compared through simulation. Results indicate that two new methods, based on robust measures reflecting the linear association between two random variables, provide reasonably accurate control over Type I errors. Drawbacks to rank-based methods are discussed.…