External validity is an important parameter that needs to be considered for decision making in health research, but no widely accepted measurement tool for the assessment of external validity of randomized controlled trials (RCTs) exists. One of the most limiting factors for creating such a tool is probably the substantial heterogeneity and lack…

Published studies of intervention effects probably report effect sizes that are larger than the true effect size. There are probably many reasons for this, but one can be thought of as a "winner's curse." In this essay, I discuss evidence from two recent studies that highlight how evidence clearinghouses might inadvertently expose…

Instrumental variables is a popular approach for causal inference in education when randomization of treatment is not feasible. Using a first-year college program as a running example, this article reviews the five assumptions that must be met to successfully use instrumental variables to estimate a causal effect with observational data: SUTVA,…

Background: A systematic review is a secondary research method that follows a predetermined protocol to identify, synthesize, and assess the quality of primary studies that meet pre-established eligibility criteria to answer a specific research question (Higgins & Green, 2011; Higgins & Thomas, 2019). It uses systematic and transparent…

The addition of 'clinically significant impairment' (American Psychiatric Association, Diagnostic and statistical manual of mental disorders, Author, 2013) to the diagnostic criteria for autism in DSM-5 attempts to establish a threshold for the condition. However, the increased prominence of the neurodiversity paradigm and social model of…

Though the ACRL "Framework" holds metacognition as crucial to exercising information literacy, its emphasis was reduced from prominence in early drafts to a single mention in the final document. At the same time, few of the frequently-taught sets of source evaluation criteria include a step for self-awareness. This raises the question:…

There has been an increasing interest in research performance in recent years. However, in previous studies, research performance has generally been measured by traditional methods. In this study, a model based on multi-criteria decision-making (MCDM) methods is proposed to evaluate the research performance of universities. In order to apply the…

Despite the increasing recognition for the scientific and societal potential of interdisciplinary research, selection committees struggle with the evaluation of interdisciplinary proposals. Interdisciplinary proposals include a wider range of theories and methods, involve a more diverse team, pose a higher level of uncertainty, and their…

The purpose of this study was to evaluate the psychometric properties of the Self-Assessment Survey (SAS) 4.0, an updated measure assessing implementation fidelity of positive behavioral interventions and supports (PBIS). A total of 627 school personnel from 33 schools in six U.S. states completed the SAS 4.0 during the 2021-2022 school year. We…

This study employs the Delphi method to ascertain intercultural scholars' current consensus on a definition, specific components, and key evaluation criteria of intercultural competence. Sixty-eight leading intercultural scholars from Euro-American and East-Asian countries participated in this study. The results are largely congruent with the…

Traditionally in England, exam results in General Certificates of Secondary Education (GCSEs) (and before them O levels) and A levels have been reported as letter grades, with A (or A*) as the top grade, then B, C etc. The reforms gave the opportunity to revisit the arguments for different formats of reporting, and Cambridge Assessment contributed…

Teaching evaluation is a central process across institutions for faculty retention, promotion, and tenure. While there is a rich literature on methods for evaluating teaching, there is less scholarship on the goals and processes for reforming systems of teaching evaluation. Surprisingly, there is little to no information on teaching criteria at…

Visual analysis and nonoverlap-based effect sizes are predominantly used in analyzing single case experimental designs (SCEDs). Although they are popular analytical methods for SCEDs, they have certain limitations. In this study, a new effect size calculation model for SCEDs, named performance criteria-based effect size (PCES), is proposed…

The Whippoorwill Award aims to bring attention to the theme of rural spaces and people in the larger genre of young adult literature. This award annually recognizes the best books for the middle grades and young adult readers that portray the value of rural spaces, knowledge, people, and cultures. The Whippoorwill Award is intended to be a…

Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…