N-of-1 trials, a special case of Single Case Experimental Designs (SCEDs), are prominent in clinical medical research and specifically psychiatry due to the growing significance of precision/personalized medicine. It is imperative that these clinical trials be conducted, and their data analyzed, using the highest standards to guard against threats…

This methodological brief introduces basic procedures and issues for conducting a high-quality meta-analysis in gifted education. Specifically, we discuss issues such as how to select a topic and formulate research problems, search for and identify qualified studies, code studies and extract data, choose and calculate effect sizes, analyze data,…

The purpose of this study was to examine the quality of quantitative articles published in the "Journal of Counseling & Development." Quality concerns arose in regard to omissions of psychometric information of instruments, effect sizes, and statistical power. Type VI and II errors were found. Strengths included stated research…

This article investigates the quality of social scientific listening research that reports numerical data to substantiate claims appearing in the "International Journal of Listening" between 1987 and 2011. Of the 225 published articles, 100 included one or more studies reporting numerical data. We frame our results in terms of eight…

Purpose: Single-subject experimental designs (SSEDs) represent an important tool in the development and implementation of evidence-based practice in communication sciences and disorders. The purpose of this article is to review the strategies and tactics of SSEDs and their application in speech-language pathology research. Method: The authors…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Some of the advantages of meta-analysis as a useful approach to synthesizing research studies are described, along with caveats that a careful analyst should consider when applying this approach to research data. (LC)

Demonstrates that magnitude-of-effects (ME) estimates vary in susceptibility to sample-size bias depending on whether they are directional or nondirectional estimates. Also demonstrates that study characteristics that influence size of ME estimates can be explicitly taken into account when comparing studies. Emphasizes need to consider study…

Shares three ideas concerning how to evaluate the practical importance of developmental findings to make them more useful to policymakers: (1) statistical significance tests need to be accompanied by effect size estimates; (2) meta-analyses are helping in using all existing data when examining issues involved in policy debates; and (3) researchers…

Presentation of quantitative research on the family often suffers from a tendency to interpret findings on a statistical rather than substantive basis. Advocates the use of data analysis that lends itself to an intuitive understanding of the nature of the findings, the strength of the association, and the import of the result. (JPS)

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

Discusses the use and advantages of integrated learning systems (ILSs) in elementary and middle grades, and reanalyzes 30 evaluations of ILSs by using effect size statistics. Research problems are described, including poor evaluation designs and inadequate data collection and analysis; and a table summarizes the ILS research reports and…