Toward the goal of more rapid knowledge accumulation via better meta-analyses, this article explores statistical approaches intended to increase the precision and comparability of effect sizes from education research. The featured estimate of the proposed approach is a standardized mean difference effect size whose numerator is a mean difference…

Randomization of large number of participants to different treatment groups is often not a feasible or preferable way to answer questions of immediate interest to professional practice. Single case designs (SCDs) are a class of research designs that are experimental in nature but require only a few participants, all of whom receive the…

University students, especially language learners, have increasingly been using machine translation (MT) systems in the last decade and for all kinds of texts, including homework, assignments and exams. This ubiquity does not translate into visibility as few teachers address the subject in class. Several researchers have shown that MT systems,…

This article presents two similar design cases and a discussion of how like values resulted in dissimilar design moves. Both cases were gamified learning activities for graduate students in instructional design. Both interventions employed rapid prototyping and were delivered synchronously in an at-a-distance setting. This article compares the two…

The What Works Clearinghouse (WWC) uses the term "baseline equivalence" when determining if the intervention group (those that received the intervention of interest) and the comparison group (those that did not receive the intervention) had characteristics that were similar enough ("equivalent") at the start of the study (at…

Qualitative comparative analysis (QCA) was originally developed as a tool for cross-national comparisons in macrosociology, but its use in evaluation and evidence synthesis of complex interventions is rapidly developing. QCA is theory-driven and relies on Boolean logic to identify pathways to an outcome (e.g., is the intervention effective or…

Bilingual students comprise a substantial and growing proportion of U.S. school enrollment and often experience unsatisfactory school outcomes attributed to limited opportunities to learn. Bilingual consultants have the unique opportunity to shape school psychological services and general education supports for all bilingual students by working…

Rigorous scholarship is essential to the continued growth of group work, yet the unique nature of this counseling specialty poses challenges for quantitative researchers. The purpose of this proposal is to overview unique challenges to quantitative research with groups in the counseling field, including difficulty in obtaining large sample sizes…

This protocol guides the review of research that informs What Works Clearinghouse (WWC) intervention reports in the Supporting Postsecondary Success topic area. The protocol is used in conjunction with the WWC Procedures and Standards Handbooks (version 4.0). This protocol focuses broadly on academic and nonacademic interventions that aim to…

Some schools use results from the MAP® Growth™ interim assessments from the Northwest Evaluation Association (NWEA®) in a number of high-stakes ways. These include as a component of their teacher evaluation systems; to determine whether a student advances to the next grade; or as an indicator for student readiness for certain programs or…

In this article, Helen Wilson, Bridget Holligan, and Pam Hanley share outcomes from the "Thinking, Doing, Talking Science" (TDTS) project, which encourages children's learning and engagement with science through simple and effective activities. The article contains the following prompts used to facilitate discussion during "The…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…

To compare the efficacy of two interventions to promote colorectal cancer screening participation and forward stage movement of colorectal cancer screening adoption among first-degree relatives of individuals diagnosed with adenomatous polyps. One hundred fifty-eight first-degree relatives of individuals diagnosed with adenomatous polyps were…

Historians collect and verify evidence and then interpret it in an acceptable way. A general consensus is that history does not present us with an absolute truth -- the most we can hope for is historians' reliable, evidentially based interpretations of the historical topic. History not viewed as interpretation has long raised alarm bells in…

Outdoor education programs have been shown to have a positive effect on the educational, physical and emotional development of youth. They are increasingly being used to foster a sense of community in schools and to provide students with learning opportunities related to the environment. This article describes an integrated outdoor education…