G. Meyer (1997) attempts to refute the present authors' criticisms of the interrater reliability of the Rorschach Comprehensive System (CS) but misrepresents their position and offers a flawed meta-analysis in support of his own. Rorschach proponents need to undertake high-quality replicated studies of CS reliability and validity. (SLD)

Replies to Wood et al. and documents limitations of their conclusions about the Rorschach Comprehensive System (CS), supporting Meyer's own meta-analysis, which finds adequate interrater reliability for the CS. (SLD)

Conducted a systematic review of randomized controlled trials of the administration of human albumin in critically ill patients. Findings raised serious concerns about the safety of an intervention that has been widely used in health care around the world. Findings illustrate the importance of systematic reviews in health care and other areas of…

The use of Monte Carlo methods demonstrated that a formula presented by M. G. Kendall for estimating Pearson's rho from tau is somewhat more accurate than a formula presented by K. Pearson for estimating Pearson's rho from a Spearman's rho coefficient. Implications for meta-analysis of correlations are discussed. (SLD)

Examined the historical growth in the popularity of statistical significance testing using a random sample of data from 12 American Psychological Association journals. Results replicate and extend findings from a study that used only one such journal. Discusses the role of statistical significance testing and the use of replication and…

The Hubbard and Ryan article is a little ingenuous in its implications for action. Both meta-analyses and replication have problems of their own; each requires careful attention. Good measurement emphasizes proper sampling techniques and using whatever means possible to analyze data. (SLD)

Agrees with R. Hubbard and P. Ryan that statistical significance testing has had a negative impact in that some users have closed their minds to alternative approaches to conducting research. In marketing, the alternatives are not completely satisfactory, however, and researchers are likely to continue to rely on statistical significance testing.…

Summarizes a meta-analysis of published research on dynamic assessment that reviewed 30 studies (170 effect sizes). Discusses factors that impact effect size, including the predictive ability of type of assessment for effect size. Discusses results in the context of assumptions related to dynamic assessment. (SLD)

The meta-analysis of coefficient alpha across many studies is becoming more common in psychology by a methodology labeled reliability generalization. Existing reliability generalization studies have not used the sampling distribution of coefficient alpha for precision weighting and other common meta-analytic procedures. A framework is provided for…

A meta-analysis of the available judgment and memory data on the sleeper effect in persuasion is presented. According to this effect, when people receive a communication associated with a discounting cue, such as a noncredible source, they are less persuaded immediately after exposure than they are later in time. Findings from this meta-analysis…

This article provides a critical review of the assumptions and findings of studies used to establish psychotherapies as empirically supported. The attempt to identify empirically supported therapies (ESTs) imposes particular assumptions on the use of randomized controlled trial (RCT) methodology that appear to be valid for some disorders and…

One version of r-sub(equivalent), calculated from Fisher's exact test p values and recommended for small samples, is considered "a more realistic... [and] a more accurate estimate of the population correlation than... the sample correlation, r-sub(sample)" (R. Rosenthal & D. B. Rubin, 2003, p. 494). Small sample properties of r-sub(sample) and of…

This article discusses meta-analysis in the context of research in gifted education. It provides the rationale for encouraging meta-analytic reviews, rather than narrative reviews, to synthesize the research in a given area. The article summarizes the results of reported meta-analyses retrieved from electronic databases and provides guidelines for…

The present review examines research on the effects of technology use on reading achievement in K-12 classrooms. Unlike previous reviews, this review applies consistent inclusion standards to focus on studies that met high methodological standards. In addition, methodological and substantive features of the studies are investigated to examine the…

In recent years, distant (remote) intercessory prayer has been put up against the scientific method of research. Studies are few, variable, and tend to be nongeneralizable. Lack of construct validity of the variable prayer is one of the weaknesses that opens up the research to valid critique and scrutiny. The belief that research in this field is…