Hierarchical models are extremely promising tools for data analysis, but it is important not to lessen hard thinking about data and iterative model checking when fitting hierarchical models. More and better software, methods to assure proper calibration, and materials in support of hierarchical model use are all needed. (SLD)

Proposes guidelines for revising the American Psychological Association (APA) publication manual or other APA materials to clarify the application of statistics in research reports. The guidelines are intended to induce authors and editors to recognize the thoughtless application of statistical methods. Contains 54 references. (SLD)

Responds to Biskin's comments (this issue) on the significance test controversy. Highlights areas of agreement (importance of replication evidence, importance of effect sizes) and disagreement (influence of sample size, evaluation of populations vs. samples, significance of Carver's article). Includes further recommendations for reporting research…

Analyzed 150 articles from the "Journal of Applied Psychology" (JAP) from 1940 to 1999 to determine statistical reporting practices related to null hypothesis significance testing, American Psychological Association guidelines, and reform recommendations. Findings show little evidence that decades of cogent criticisms by reformers have…

The theories of validity developed over the past 60 years are quite sophisticated, but the methodology of validity is not generally very effective. The validity evidence for major testing programs is typically much weaker than the evidence for more technical characteristics such as reliability. In addition, most validation efforts have a strong…

Since data in social and behavioral sciences are often hierarchically organized, special statistical procedures for covariance structure models have been developed to reflect such hierarchical structures. Most of these developments are based on a multivariate normality distribution assumption, which may not be realistic for practical data. It is…

This study investigated the level of generalizability across a few high quality assessment tasks and the validity of measuring student writing ability using a limited number of essay tasks. More specifically, the research team explored how well writing prompts could measure student general writing ability and if student performance from one…

This paper presents findings from a qualitative study that compared the learning experiences of a group of students from a technology-based college-level introductory statistics course with the learning experiences of a group of students with non-technology-based instruction. Findings from the study indicate differences with regards to classroom…

Purpose: This study examined the association between cognitive functioning and completion of a durable power of attorney for health care. Design and Methods: Participants were from the Second Longitudinal Study on Aging (LSOA II), a nationally representative sample of community-dwelling persons who were at least 70 years of age at the time of…

A study examined whether composition specialists can counterbalance the potential privileging of the assessment perspective, or of self-appointed interpreters of that perspective, through the study of assessment discourse as text. Fourteen assessment texts were examined, most of them journal articles and most of them featuring the common…

Evaluates arguments concerning the generality and statistical analysis of single-subject data. Considers the role of philosophy of science in evaluating research methodology. Single-subject data have special relevance for psychologists and educators who focus on the individual but statistical techniques for analyzing data have numerous…

Demonstrates the consequences on total misdiagnosis rates of using conventional (fixed) rather than flexible (Bayesian) rules when using the Minnesota Multiphasic Personality Inventory in diagnosis. Concludes that the range of base rates and the separation of distributions of normal and abnormal scores affect the difference in the misdiagnosis…

Many research-related classes in social sciences present probability as a unified approach based upon mathematical axioms, but neglect the diversity of various probability theories and their associated philosophical assumptions. Although currently the dominant statistical and probabilistic approach is the Fisherian tradition, the use of Fisherian…

Methods by which structural models correct for the effects of attenuation due to measurement error are reviewed, and implications of such disattenuation for interpreting the results of structural equation models are considered. Recommendations are made for improving the practice of disattenuation, and caution is urged in drawing inferences based…

Summarizes Tarski's semantic truth theory to clarify different aspects of implication. Extends the classical definition of implication as a relationship between propositions to a relationship between open sentences with at least one free variable. Analyzes two problematic situations and the presentation of some experimental results from research…