The purpose of this synthesis study was to assess the reliability and validity of the Draw-A-Scientist Test (DAST) and its variations across multiple studies, aiming to understand limitations and propose modifications for future application within and beyond the science domain. Given the existence of multiple DAST versions, this study quantified…

This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positive correlations between Wonderlic scores and academic performance in general ([r-bar] = 0.26), between Wonderlic scores and undergraduate GPA in…

The "k"-means clustering method, while widely embraced in college student typology research, is often misunderstood and misapplied. Many researchers regard "k"-means as a near-universal solution for uncovering homogeneous student groups, believing its success hinges primarily on the selection of an appropriate "k."…

This systematic review aims to provide a complementary to existing synopses of the state-of-the-art of mathematics education research on "proof" and "proving" in both school and university mathematics. As an organizing framework, we used Cohen et al.'s triadic conceptualization of instruction, which draws attention not only to…

The learning environment (LE) includes social interactions, organizational culture, structures, and physical and virtual spaces that influence the learning experiences of students. Despite numerous studies exploring the perception of healthcare professional students (HCPS) of their LE, the validity evidence of the utilized questionnaires remains…

Given the absence of expertise criteria of academics or lecturers, we sought to explore relevant studies to formulate an informed framework of academic expertise. Academics at higher education institutions are often considered experts. Usually, academic roles comprise teaching, research, and community service. Therefore, academics' expertise…

This paper reports on a systematic literature review to understand better methodologies and data collection tools used to judge student teaching effectiveness, ways in which validity and reliability are considered, the processes involved in assessing new teaching effectiveness within teacher education programmes, and how evaluation and results are…

Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

Outside of education, many academic disciplines developed and promulgated checklists to evaluate the quality of qualitative studies. This article used an embedded mixed methods approach in three stages: development of a conceptual framework reviewing 62 guidelines; a content analysis of key areas of the guidelines; and review of dissertations to…

Evaluating digital competencies has become a topic of growing interest in recent years. Although several reviews and studies have summarized the main elements of progress and shortcomings in this area, some issues are yet to be explored. Very little information is available about the ways of ensuring the validity and reliability of the instrument…

This review presents the first comprehensive synthesis of available research on selection methods for STEM graduate study admissions. Ten categories of graduate selection methods emerged. Each category was critically appraised against the following evaluative quality principles: predictive validity and reliability, acceptability, procedural…

The Ottawa Surgical Competency Operating Room Evaluation (OSCORE) is an assessment tool that has gained prominence in postgraduate competency-based training programs. We undertook a systematic review and narrative synthesis to articulate the underlying validity argument in support of this tool. Although originally developed to assess readiness for…

This article reports on the development and initial validation of the Intention to Use Technology-enabled Learning (I-TEL) Scale. Data from 313 preservice teachers were used to examine the instrument's psychometric properties. Principal axis factoring (PAF) indicated a five-factor structure consisting of 22 items. The scale, as well as the…

Human raters' assessment of interpreting is a complex process. Previous researchers have mainly relied on verbal reports to examine this process. To advance our understanding, we conducted an empirical study, collecting raters' eye-movement and retrospection data in a computerised interpreting assessment in which three groups of raters (n = 35)…

Although fairness in assessment practices has gained noticeable attention over the recent years, there has been a long-lasting study to design and validate a questionnaire to measure it from a psychometric perspective. Thus, this study aims to develop and validate a questionnaire with adequate psychometric properties to measure fairness in…