A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

This technical supplement to the Supplemental Nutrition Assistance Program (SNAP) Employment and Training (E&T) evaluation final reports presents details of the technical approach used for creating analysis variables and estimating impacts of treatment group services on outcomes, including employment, earnings, and SNAP participation. It also…

This tutorial uses publicly available data from drug makers and the Food and Drug Administration to guide learners to estimate the confidence intervals of COVID-19 vaccine efficacy rates with a Bayesian framework. Under the classical approach, there is no probability associated with a parameter, and the meaning of confidence intervals can be…

Policymakers and institutional leaders in higher education too often make decisions based on descriptive data analyses or even anecdote when better analysis options could produce more nuanced and more valuable results. Employing the setting of higher education program evaluation at a midwestern regional public university, for this study we…

While doctoral leadership programs have widely adopted Improvement Science (IS) as a signature pedagogy, few studies have examined how to best equip doctoral students with the knowledge and research skills they need to utilize IS in practice. More specifically, research is needed to determine the most effective and meaningful pedagogy for…

Single case experimental designs are an important research design in behavioral and medical research. Although there are design standards prescribed by the What Works Clearinghouse for single case experimental designs, these standards do not include statistically derived power computations. Recently we derived the equations for computing power for…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

As the use of data in courses that incorporate statistical methods has become more prevalent, so has the need for tools for working with such data, including those for data creation and adjustment. While numerous tools exist that support faculty who teach statistical methods, many are focused on data analysis or theoretical concepts, and there…

This article describes a modified importance-performance framework for use in evaluation of recreation-based experiential learning programs. Importance-performance analysis (IPA) provides an effective and readily applicable means of evaluating many programs, but the near universal satisfaction associated with recreation inhibits the use of IPA in…

The major aim of this manuscript is to bring together two important topics that have recently received much attention in child and adolescent research, albeit separately from each other: single-case experimental designs and statistical mediation analysis. Single-case experimental designs (SCEDs) are increasingly recognized as a valuable…

This paper provides introductory statistics instructors with the capacity to use engaging National Basketball Association (NBA) data within a web application to either strengthen students' understanding or introduce the concept of variance and one-way analysis of variance. Using engaging data within the classroom provides context to data that…

The ability to collaborate with culturally diverse groups is essential, not only to further scientific knowledge but also to solve complex global problems. However, not all students have opportunities to develop intercultural competencies through study abroad programs, due to various issues such as cost, rigid curriculum, and unrelated field of…

The article presents some notes on normalization and illustrates these procedures using graphing functions in R. Using real data, the paper also presents an R package and online Shiny app that efficiently transforms variables in large datasets.

There are several factors that contribute to the shrinking supply of teachers. Fewer individuals are pursuing teaching as a career; in the United States, for example, teacher education enrollments plunged 35% between 2009 and 2014 (Berry & Shields, 2017). In direct relation to the decrease in students entering preservice teaching, fewer…

The Becoming A Man (BAM) program is a school-based group counseling and mentoring program run by Youth Guidance (YG), a community organization that serves children in Chicago schools who are at risk. BAM guides young men to learn, internalize, and practice social cognitive skills, make responsible decisions for their future, and become positive…