Aptitude testing is used to select candidates with the greatest potential for professional interpreter training. Implicit in this practice is the expectation that aptitude test scores predict future performance. As such, the predictive validity of score-based inferences and decisions constitutes an important rationale for aptitude testing.…

Survey-based research is vital in education and social sciences, offering insights into human behaviors and perceptions. The prevalence of such studies in medical education has risen by 33% over the past decade. Despite this growth, the utility of survey findings depends on the study design quality and measure validity. Many manuscripts are…

The "k"-means clustering method, while widely embraced in college student typology research, is often misunderstood and misapplied. Many researchers regard "k"-means as a near-universal solution for uncovering homogeneous student groups, believing its success hinges primarily on the selection of an appropriate "k."…

We aimed to evaluate the performance of supervised machine learning algorithms in predicting articles relevant for full-text review in a systematic review. Overall, 16,430 manually screened titles/abstracts, including 861 references identified relevant for full-text review were used for the analysis. Of these, 40% (n = 6573) were sub-divided for…

Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to…

Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

A critical revisiting of research methods with multilingual learners raises issues of validity that are often unaddressed in current discussions of research quality. Though validity is conceptualized and assessed differently across research traditions, validity broadly describes the production of findings that are credible and trustworthy. The…

For medical educators, autoethnography as a research methodology provides a means of active engagement in reflective practice, ranging from teaching and educational innovation to interactions with patients and colleagues. In this way, they may benefit from the systematic reflexivity required, improve their interactions with the people around them,…

In response to considerable critique of its rigour and relevance, the field of educational research has sought to prove its validity, both in terms of its scientific legitimacy and its relevance to policy and practice. One result of this has been a heightened concern with methodology, to the extent that a form of methodolatry has developed. In…

In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches have been…

Since 1983, the Instructional Theory Framework (ITF) (and its subsequent improvements) has guided instructional designers and researchers in designing and developing useful learner experiences (LX). For the past 40 years, the ITF was laser-focused on the selection of instructional methods, downplaying delivery methods (media) and management…

Most disability research is conducted in high-income countries, despite much of the world's population living in low- and middle-income countries. Given the flexible nature of qualitative research, studies using this methodology have the potential to provide important insights into how disability is perceived across the globe. The aim of the…

Social validity of interventions is often conceptualized as a triad of the social significance of goals, the acceptability of procedures, and the importance of intervention outcomes (Wolf, 1978). Social validity measurement is considered an essential part of quality single-case design studies. Yet, the practice has been inconsistently reflected in…

Assessing student achievement over multiple years is complicated by students' memberships in shifting upper-level nesting structures. These structures are manifested in (1) annual matriculation to different classrooms and (2) mobility between schools. Failure to model these shifting upper-level nesting structures may bias the inferences…

Single-case comparative studies could help identify efficient instructional procedures for individuals with disabilities. However, previous literature reported inconsistent efficiency results if multiple comparisons were conducted, indicating that within-participant replication was uncommon. In this review, we examined single-case comparative…