Human ratings are ubiquitous in creativity research. Yet, the process of rating responses to creativity tasks -- typically several hundred or thousands of responses, per rater -- is often time-consuming and expensive. Planned missing data designs, where raters only rate a subset of the total number of responses, have been recently proposed as one…

Institutional ethics review procedures aim -- in principle -- to minimise harm and evaluate risks, providing an important space to consider the safety of participants and researchers. However, literature has questioned the effectiveness of the process, particularly for reviewing 'risky' topics in a risk-averse environment. This article reports the…

Background: Rapid reviews involve a streamlined approach to knowledge synthesis. They are used to identify high-quality evidence for the purpose of informing decisions and initiatives, completed over relatively short timeframes, and have been found to reach conclusions that do not differ extensively from full systematic reviews. Although common in…

The primary purpose of Institutional Review Boards (IRBs) is to protect the rights and welfare of human research participants. Evaluation and measurement of how IRBs satisfy this purpose and other important goals are open questions that demand empirical research. Research on IRBs, and the Human Research Protection Programs (HRPPs) of which they…

This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

People with intellectual disabilities (IDs) have experienced involuntary and inhumane research practices. Consequently, researchers have shifted towards "excluding" those with IDs; caregivers, teachers, or peers compose study samples, dominating a space they "indirectly" experience. Researcher bias regarding intellectual…

Researchers seeking to engage in projects related to Tribal communities and their citizens, lands, and non-human relatives are responsible for understanding and abiding by each Tribal nation's research laws and review processes. Few studies, however, have described the many diverse forms of Tribal research review systems across the United States…

Research ethics reviews are an integral component of the research process in education, but little is known about educators' perceptions of and experiences with this process. This exploratory study examines educators' perceptions of and experiences with the reviews of research ethics and, in this way, it contributes to a better understanding of…

When conducting human subjects research, social and behavioral researchers seeking to study current issues involving immigrants, refugees, and undocumented students must submit their research to an institutional review board (IRB). Research applications proposing to enroll these populations lie outside the scope of vulnerable populations named in…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

Institutional review boards have a dual goal: first, to protect the rights and welfare of human research subjects, and second, to support and facilitate the conduct of valuable research. In striving to achieve these goals, IRBs must often consider conflicting interests. In the discussion below, we characterize research oversight as having three…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

Funders and policymakers are increasingly recognizing the afterschool field for its vital role in supporting the social and emotional growth and academic achievement of school-age youth. Although this recognition is welcome, it often comes with increased expectations for high-quality research demonstrating the value of programming. To satisfy…

Bullying, often considered an interpersonal or intergroup behaviour, has not been explored as an unintended artefact of organisational structure. Institutional review boards (IRBs), the 'human research ethics committees' at US universities, help oversee the protection of human research subjects, particularly in the social sciences within…

Borrowing from a clinical psychology observational methodology, thin-slice observations were used to assess autism characteristics in toddlers. Thin-slices are short observations taken from a longer behavior stream which are assigned ratings by multiple raters using a 5-point scale. The raters' observations are averaged together to assign a…