A guide for professional counselors and counseling researchers for calculating and interpreting Percent Improvement as an indicator of clinical significance is provided. Strategies for reporting findings are described and illustrated. Guidelines for contextualizing discussions of clinical significance within the boundaries of psychometric evidence…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

We present considerations for validity when a population outside of a normed sample is assessed and those data are interpreted. Using a career group counseling example exploring life satisfaction changes as evidenced by the Quality of Life Inventory (Frisch, 1994), we showcase qualitative and quantitative approaches to explore how normative data…

Discusses problems researchers face when they want to describe relationship between several predictors and criterion variable. Considers ways of addressing problem of contribution of each predictor depending on which other predictors are in regression equation. Focuses on parallel information for each variable, examining initial and final…

Notes that presence of heterogeneous regression slopes in an analysis of covariance design is equivalent to presence of interaction in randomized-blocks design. Describes modification of the usual graphical representation of heterogeneous regressions that can aid in interpreting significant regions for regression surfaces. (NB)

Responds to Biskin's comments (this issue) on the significance test controversy. Highlights areas of agreement (importance of replication evidence, importance of effect sizes) and disagreement (influence of sample size, evaluation of populations vs. samples, significance of Carver's article). Includes further recommendations for reporting research…

Offers suggestions for proper procedures for authors to use--and some pitfalls to avoid--when writing studies using factor analysis methods. Discusses distinctions among different methods of analysis, the adequacy of factor structure, and other notes of caution. Encourages authors to ensure that their research is statistically sound. (RJM)

Develops basic concepts of generalizability theory using hypothetical study of reliability of scores of vocational interest inventory. Asserts that generalizability theory makes it possible to consider all possible sources of unreliability simultaneously and to design optimal decision-making study. (NB)

Significance tests are often used inappropriately in counseling research. In addition to comments on the significance test controversy (Vacha-Haase and Nilsson, this issue), a wider historical context and personal experiences are provided. The controversy is discussed, and seven recommendations for using significance tests are included. (EMK)

Statistical significance reporting and use in educational and psychological research is reviewed. An assessment of the use of statistical significance in articles published in MECD from 1990-1996 is presented. The elements of statistical significance (including sample size, effect size, and power), interpretation of results, common erroneous…