Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

The "LFK" index has been promoted as an improved method to detect bias in meta-analysis. Putatively, its performance does not depend on the number of studies in the meta-analysis. We conducted a simulation study, comparing the "LFK" index test to three standard tests for funnel plot asymmetry in settings with smaller or larger…

Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends…

Adolescence is a critical developmental period that is marked by drastic changes in face recognition, which are reflected in patterns of bias (i.e., superior recognition for some individuals compared to others). Here, we evaluate how race is perceived during face recognition and whether adolescents exhibit an own-race bias (ORB). We conducted a…

Influence from bias is unavoidable in clinical decision-making, and mental health assessment seems particularly vulnerable. Individuals with intellectual disabilities have increased risk of developing co-occurring mental disorder. Due to the inherent difficulties associated with intellectual disabilities, assessment of mental health in this…

This study, grounded in a phenomenological exploration, investigates whether current teacher evaluation methods account for subjectivism in teaching, learning, and evaluation within the context of Georgia's Teacher Keys Effectiveness System TKES. Through focus groups with instructional evaluators IEs, the study reveals the significant impact of…

The purpose of the current paper is to provide a step-by-step tutorial for employing the list experiment to control for Social Desirability Bias (SDB). Sport management scholars routinely rely on self-report data in cross-sectional settings to test research hypotheses. However, concerns exist regarding the use of self-reports without adjusting for…

Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a…

What is bias? A review of the library literature reveals no attempts to define the concept. Nor does it reveal systematic attempts to develop interventions that teach the identification and evaluation of bias. Current pedagogical approaches (checklists and bias charts) tend to assume a self-evident definition that categorises bias as…

While significant attention has been given to test equating to ensure score comparability, limited research has explored equating methods for rater-mediated assessments, where human raters inherently introduce error. If not properly addressed, these errors can undermine score interchangeability and test validity. This study proposes an equating…

Predictive student models are increasingly used in learning environments due to their ability to enhance educational outcomes and support stakeholders in making informed decisions. However, predictive models can be biased and produce unfair outcomes, leading to potential discrimination against certain individuals and harmful long-term…

Anonymous marking, as a means to mitigate bias in grading, involves evaluating student work with their identities withheld. Anonymous marking is explored in this self-study to mitigate implicit bias, which negated a practitioner-researcher's educational values. The mixed methods action research findings show withholding student identities during…

This literature review provides an overview of the various modern approaches in talent programs for the context of schools and sports reported in scientific journals (2009-2019) and presents their similarities and differences and options for cross-pollination between contexts. This is a first attempt to overarch contexts regarding talent…

Due to subjectivity in oral assessment, much concentration has been put on obtaining a satisfactory measure of consistency among raters. However, the process for obtaining more consistency might not result in valid decisions. One matter that is at the core of both reliability and validity in oral assessment is rater training. Recently,…

For over 30 years, calls have been issued for the western evaluation field to address implicit bias in its theory and practice. Although many in the field encourage evaluators to be culturally competent, ontological competence remains unaddressed. Grounded in an institutionalized distrust of non-western perspectives of reality and knowledge…