Proposes and illustrates a new method by which "what if" analyses can be conducted using estimated true population effects. Use of these "what if" methods may prevent authors with large sample sizes from overinterpreting their small effects once they see that the small effects would no longer have been statistically significant with only a…

Illustrates a number of ways in which confidence intervals for reliability coefficients can be estimated. Suggests that authors who submit articles to "Educational and Psychological Measurement" report confidence intervals for reliability estimates whenever they report score reliabilities and that they note the interval estimation…

The use of three aspects of recommended practice (language use, replicability analyses, and reporting effect sizes) was studied in quantitative reports in "The Journal of Experimental Education" (JXE) for the academic years 1994-95 and 1995-96. Examples of both errors and desirable practices in the use and reporting of statistical…

Asserts that editors should declare their expectations publicly and expose the rationale for editorial policies to public scrutiny. Supports effect size reporting and the reporting of score reliabilities. Argues against stepwise methods. Also discusses the interpretation of structure coefficients and the use of confidence intervals. (SLD)

Introduces the three subsequent articles from this special section, which extend the discussion of future prospects for progress in the reporting and interpreting of effect sizes by researchers. The authors of these pieces represent diverse views. (SLD)

A study examined effect-size reporting in 23 quantitative articles reported in "Exceptional Children". Findings reveal that effect sizes are rarely being reported, although exemplary reporting practices were also noted. Reasons why encouragement by the American Psychological Association to report effect size has been ineffective are…

Editorial board members of "Educational and Psychological Measurement" were asked to list up to five publications each, written since roughly 1950, that they thought were seminal to shaping the measurement field. This bibliography lists 59 of their selections as a "hit parade" of measurement readings. (SLD)

The mission of the "Journal of Counseling and Development" (JCD) includes the attempt to serve as a "scholarly record of the counseling profession" and as part of the "conscience of the profession." This responsibility requires the willingness to engage in self-study. This study investigated two aspects of research…

Canonical correlation analysis is a sophisticated multivariate technique that subsumes all parametric methods (the "t"-test, analysis of variance, analysis of covariance, multivariate analysis of variance, multivariate analysis of covariance, and discriminant analysis) as special cases. This bibliography lists 83 applications of…

The Administrator Professional Leadership Scale (APLS) was developed to measure the professional leadership quality of a school principal, and to provide principals with anonymous feedback on teachers' perceptions of their leadership. Further refinement was carried out to increase its reliability; to discover categories of administrator behavior…

Web-based statistical instruction, like all statistical instruction, ought to focus on teaching the essence of the research endeavor: the exercise of reflective judgment. Using the framework of the recent report of the American Psychological Association (APA) Task Force on Statistical Inference (Wilkinson and the APA Task Force on Statistical…

The use of tests of statistical significance was explored, first by reviewing some criticisms of contemporary practice in the use of statistical tests as reflected in a series of articles in the "American Psychologist" and in the appointment of a "Task Force on Statistical Inference" by the American Psychological Association…

Suggestions are presented for being successful in publishing research results and for disseminating results once they are published. Writing style is the single most important ingredient for success in publishing, and revision is the usual prerequisite for style. Selecting target journals before writing can maximize the manuscript's chances of…

Researchers too frequently consider the reliability of the scores they analyze, and this may lead to incorrect conclusions. Practice in this regard may be negatively influenced by telegraphic habits of speech implying that tests possess reliability and other measurement characteristics. Styles of speaking in journal articles, in textbooks, and in…

Dissertations are an important component of the effort to generate knowledge. Thus, dissertation quality may be seen by accreditation and coordinating-board reviewers as a noteworthy reflection on the quality of doctoral programs themselves. The present study reviews methodological errors within Ph.D. dissertations. The illustrative errors are…