We present a new tool for meta-analysis, "Meta-Essentials," which is free of charge and easy to use. In this paper, we introduce the tool and compare its features to other tools for meta-analysis. We also provide detailed information on the validation of the tool. Although free of charge and simple, "Meta-Essentials"…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…

In this article, I provide answers to the questions posed by Will Shadish about the history and development of the Schmidt-Hunter methods of meta-analysis. In the 1970s, I headed a research program on personnel selection at the US Office of Personnel Management (OPM). After our research showed that validity studies have low statistical power, OPM…

In this article I provide an overview of the methodological issues involved in measuring constructs relevant to character development and education. I begin with a nontechnical overview of the 3 fundamental psychometric properties of measurement: reliability, validity, and equivalence. Developing and evaluating measures to ensure evidence of all 3…

This chapter introduces three applications of Bayesian inference to common and novel issues in second language research. After a review of the critiques of conventional hypothesis testing, our focus centers on ways Bayesian inference can be used for dealing with missing data, for testing theory-driven substantive hypotheses without a default null…

Single-case design (SCD) research focuses on finding powerful effects, but the influence of this methodology on the evidence-based practice (EBP) movement is questionable. Meta-analytic procedures may help facilitate the role of SCD research in the EBP movement, but meta-analyses of SCDs are controversial. The current article provides an…

The authors have over the years tried to revise meta-analysis because it's basic premise is to add apples and oranges together and analyze. In other words, various data on the same subject are chosen using different samples, research strategies, and number properties. The findings are then homogenized and a statistical analysis is used (Snell, J.…

This article elaborates on the centrality of interventions for social work practice and the importance of understanding the effects of interventions for a more efficient, harmless, transparent, and ethical social work practice. Low-bias research designs and meta-analyses are important means of generating the best possible evidence on what works in…

Good quantitative evidence does not require large, aggregate group designs. The authors describe ground-breaking work in managing the conceptual and practical demands in developing meta-analytic strategies for single subject designs in an effort to add to evidence-based practice. (Contains 2 figures.)

Presents 40 questions, commentaries, and rebuttals on the generalizability of validities of employment tests of cognitive abilities and meta analysis. (BL)

During the 1990s, the use of meta-analytic methods in educational research has been widespread, and few aspects of education have escaped the meta-analytic revolution. The acceptance has not been complete, however, and several threats to validity remain. Prominent among these are the "normality" problem and the "independence"…

Summarizes issues associated with psychological assessment, concluding that: psychological test validity is strong and is comparable to medical test validity; distinct assessment methods provide unique sources of information; and clinicians who rely solely on interviews are prone to incomplete understandings. Suggests that multimethod assessment…

The validity generalization model of meta analysis is described and modified for application to concurrent validity studies of motor behavior. An example is presented. (Author/MT)

Describes and discusses metanalysis and criticisms of the methodology. Reports on a pilot study which tested the feasibility of metanalytic methods in library science research using the literature on paper- or computer-based information retrieval. (28 references) (EA)

The history of risk assessment in criminal justice has been written on several occasions. In this article, the authors assess progress since Andrews, Bonta, and Hoge's statement of the human service principles of risk-need-responsivity (RNR) and professional discretion. The review is conducted in the context of the advent of the fourth generation…