Background: Rapid reviews involve a streamlined approach to knowledge synthesis. They are used to identify high-quality evidence for the purpose of informing decisions and initiatives, completed over relatively short timeframes, and have been found to reach conclusions that do not differ extensively from full systematic reviews. Although common in…

People with intellectual disabilities (IDs) have experienced involuntary and inhumane research practices. Consequently, researchers have shifted towards "excluding" those with IDs; caregivers, teachers, or peers compose study samples, dominating a space they "indirectly" experience. Researcher bias regarding intellectual…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

Funders and policymakers are increasingly recognizing the afterschool field for its vital role in supporting the social and emotional growth and academic achievement of school-age youth. Although this recognition is welcome, it often comes with increased expectations for high-quality research demonstrating the value of programming. To satisfy…

Bullying, often considered an interpersonal or intergroup behaviour, has not been explored as an unintended artefact of organisational structure. Institutional review boards (IRBs), the 'human research ethics committees' at US universities, help oversee the protection of human research subjects, particularly in the social sciences within…

All researchers who use human participants in their study must obtain permission from their appropriate Institutional Review Board (IRB). Once the IRB application enters the review process, a decision is made regarding the type of review it should receive: Level I administrative (exempt), Level II subcommittee (expedited), or Level III full board…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

The purpose of this paper is to share a description of the process used by Fort Hays State University (FHSU) as a self-study of the FHSU alternative certification program, known as Transition to Teaching. Team members used the Quality Indicators designed as a part of a Department of Education Transition to Teaching Grant called the KNOTtT Project.…

Legitimate knowledge claims about causation have been a central concern among evaluators and applied researchers for several decades and often have been the subject of heated debates. In recent years these debates have resurfaced with a renewed intensity, due in part to the priority currently being given to randomized experiments by many funders…

Many academic librarians are interested in pursuing research studies that involve students, faculty, and other library patrons; these projects must be approved by an institutional review board (IRB). This article reviews federal requirements and regulations for human subjects research and explains the IRB application process. The author discusses…

What kinds of ethical dilemmas do people who are new to the profession of evaluation face? Are they different from the challenges faced by more experienced evaluators? What strategies do they use to resolve them? These questions were the starting point for the essays included in this issue of the Ethical Challenges section. The essays were written…

A central task of evaluation is to use systematic inquiry to judge the merit, worth, and significance of programs. As a field in education, evaluation began to mature during the 1960s, when policy makers began funding researchers to study the impact of Great Society programs. Since that time, evaluation and policy-making have been intertwined,…

This article narrates the author's experience of obtaining institutional review board (IRB) approval for her dissertation study. Although her research topic was particularly sensitive, this case is illustrative of the increasing level of difficulty qualitative researchers are facing in conducting not only risky research but also work that is not…

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…