Limitations of dummy coding and nonsense coding as methods of coding categorical variables for use as predictors in multiple regression analysis are discussed. The combination of these approaches often yields estimates and tests of significance that are not intended by researchers for inclusion in their models. (SLD)

Multiple evaluation methods (MEMs) can cause an inferential challenge, although there are strategies to strengthen inferences. Practical and theoretical issues involved in the use by social scientists of MEMs, three potential problems in drawing inferences from MEMs, and short- and long-term strategies for alleviating these problems are outlined.…

The utility and interpretation of a coefficient derived by use of the generalizability theory is discussed in this article. Then it is employed to assess the reliability of several school-level variables from the High School and Beyond study. (JD)

This paper advocates the use of nonparametric statistics. First, the consequence of using parametric inferential techniques under nonnormality is described. Second, the advantages of using nonparametric techniques are presented. The third purpose is to demonstrate empirically how infrequently nonparametric statistics appear in studies, even those…

Coefficient alpha is a simple and very useful index of test reliability that is widely used in educational and psychological measurement. Classical statistical inference for coefficient alpha is well developed. This paper presents two methods for Bayesian statistical inference for a single sample alpha coefficient. An approximate analytic method…

This paper makes the point that descriptive and inferential measures of nonnormality and graphic displays of the frequency distribution of important variables should be routine in research reporting. This point is particularly true for research involving measures with nonarbitrary metrics where the distribution shape is unaffected by measurement…

Hierarchical models are extremely promising tools for data analysis, but it is important not to lessen hard thinking about data and iterative model checking when fitting hierarchical models. More and better software, methods to assure proper calibration, and materials in support of hierarchical model use are all needed. (SLD)

Proposes guidelines for revising the American Psychological Association (APA) publication manual or other APA materials to clarify the application of statistics in research reports. The guidelines are intended to induce authors and editors to recognize the thoughtless application of statistical methods. Contains 54 references. (SLD)

Responds to Biskin's comments (this issue) on the significance test controversy. Highlights areas of agreement (importance of replication evidence, importance of effect sizes) and disagreement (influence of sample size, evaluation of populations vs. samples, significance of Carver's article). Includes further recommendations for reporting research…

Analyzed 150 articles from the "Journal of Applied Psychology" (JAP) from 1940 to 1999 to determine statistical reporting practices related to null hypothesis significance testing, American Psychological Association guidelines, and reform recommendations. Findings show little evidence that decades of cogent criticisms by reformers have…

The theories of validity developed over the past 60 years are quite sophisticated, but the methodology of validity is not generally very effective. The validity evidence for major testing programs is typically much weaker than the evidence for more technical characteristics such as reliability. In addition, most validation efforts have a strong…

Since data in social and behavioral sciences are often hierarchically organized, special statistical procedures for covariance structure models have been developed to reflect such hierarchical structures. Most of these developments are based on a multivariate normality distribution assumption, which may not be realistic for practical data. It is…

The purpose of this research was to manipulate the component of confidence found in Keller's ARCS Model to enhance the confidence and performance of undergraduate students enrolled in an online course at a Texas University. This experiment used SAM Office 2003 and WebCT for the delivery of the tactics, strategies, confidence-enhancing e-mails…

A study examined whether composition specialists can counterbalance the potential privileging of the assessment perspective, or of self-appointed interpreters of that perspective, through the study of assessment discourse as text. Fourteen assessment texts were examined, most of them journal articles and most of them featuring the common…

Evaluates arguments concerning the generality and statistical analysis of single-subject data. Considers the role of philosophy of science in evaluating research methodology. Single-subject data have special relevance for psychologists and educators who focus on the individual but statistical techniques for analyzing data have numerous…