Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

This important new book provides the first in-depth, authoritative and balanced examination of the critical issues pervading Social and Emotional Learning (SEL). The book highlights strengths and flaws in SEL theory and research, and sets the agenda for the next generation of inquiry. The book investigates key topics such as: (1) definitions and…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

The Research to Practice (RTP) column in "The Journal of Continuing Higher Education" has recently focused on evaluation methods that continuing education (CE) units can utilize, reports on surveys of CE practitioners, and recommendations for research on dynamics that impact CE programs and the students enrolling in them. In this article, the…

The paper offers a retrospective evaluation of recent evaluative studies of bilingual programs in the Australian state of Victoria, in an attempt to determine how successfully the evaluation process met the dual criteria of external accountability and development. The programs in question were located in primary or secondary government schools and…

Available resources and indicators of high quality inclusive practices are presented in this compilation. Assembling many different resources in one place allows for easy comparison of potential indicators of quality. Excerpts and adaptations of the resources are intended to provide some familiarity with the content of each resource and encourage…

Cluster randomized trials (CRTs) have been widely used in field experiments treating a cluster of individuals as the unit of randomization. This study focused particularly on situations where CRTs are accompanied by a common complication, namely, treatment noncompliance or, more generally, intervention nonadherence. In CRTs, compliance may be…

Addressing the increasing psychological needs on campus is a central mission of most college counseling centers. In addition, many centers are expected to contribute to student academic success and retention. Through the use of outcomes based assessment, which examines the needs, expectations, and perceptions of students, counseling centers can…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

Brief case studies of three projects are presented to illustrate the steps which open "Wonderful Programs" to evaluation research. The evaluator is provided with the perspective needed to believe the evaluation is worth doing. The project staff is then redirected to the need for a new type of evidence. An ongoing review of the commitment…

Government and public focus on accountability for program outcomes, combined with practical and ethical constraints on experimental designs, make nonexperimental studies of social programs an increasingly common approach to producing information on program performance. In this paper, we compare the effectiveness of alternative nonexperimental…