Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

Purpose: This paper aims to explore how an academic researcher and a practitioner experience scepticism for their qualitative research. Design/methodology/approach: The study applies Olt and Teman's new conceptual phenomenological polyethnography (2019) methodology, a hybrid of phenomenology and duoethnography. Findings: For the…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

Indirect questioning techniques such as the randomized response technique aim to control social desirability bias in surveys of sensitive topics. To improve upon previous indirect questioning techniques, we propose the new Cheating Detection Triangular Model. Similar to the Cheating Detection Model, it includes a mechanism for detecting…

Address-based sampling (ABS) refers to the use a list of addresses derived from the U.S. Postal Service's Computerized Delivery Sequence File as a sampling frame. While most residential addresses are included on an ABS frame, it still suffers from undercoverage. Undercoverage is problematic only if the uncovered units have different attributes…

The attitude of teachers towards inclusive education is a key issue for the success of inclusive education. Many studies have been designed to assess teachers' attitudes, but none have looked at the bias caused by teachers' non-response to questionnaires on their attitudes. Non-response biases are difficult to identify because it is impossible to…

Audit correspondence studies are field experiments that test for discriminatory behavior in active markets. Researchers measure discrimination by comparing how responsive individuals ("audited units") are to correspondences from different types of people. This article elaborates on the tradeoffs researchers face between sending audited…

This article examines an important and thorny problem in interview research: How to assess whether what people say motivated their actions actually did so? We ask three questions: What specific challenges are at play? How have researchers addressed them? And how should those strategies be evaluated? We argue that such research faces at least five…

Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010-2011. A key step is the construction of indices of nonresponse bias based on proxy…

The "School Strike 4 Climate" is a timely opportunity for education and research sectors to support youth stories in climate change policy, and foster impactful relationships between researchers, teachers and students. But much research in this space has inherent selection biases where youth representation in research is limited by place…

School psychology contributes to the science of human behavior and utilizes this science to inform an evidence-based practice. The usefulness of this science is dependent on scientists making good faith efforts to minimize bias in their research. Nonetheless, implicit biases can still influence scientists' decisions and, hence, the outcomes of…

Standard meta-analysis methods are vulnerable to bias from incomplete reporting of results (both publication and outcome reporting bias) and poor study quality. Several alternative methods have been proposed as being less vulnerable to such biases. To evaluate these claims independently we simulated study results under a broad range of conditions…

This article provides a reflexive account of the authors' experiences of the ethical challenges in conducting a higher degree by research (HDR) supervision project prompted by the ethics review process in a major Australian university. The authors also raise epistemological questions about the specific focus of the study, given the interrelations…

Judgments of learning (JOLs) play a fundamental role in helping learners regulate their study strategies but are susceptible to various kinds of illusions and biases. These can potentially impair learning efficiency, and hence understanding the mechanisms underlying the formation of JOLs is important. Many studies have suggested that both…

The historical turn in social science has prompted scholars to engage with the work of historians on a large scale. Here, social scientists face two standard problems of selection bias: confirmation bias and convenience sampling. So far, the record of dealing with these problems has been poor, and little has been done to specify how social…