As a crucial method in organizational and social behavior research, self-report surveys must manage method bias. Method biases are distorted scores in survey response, distorted variance in variables, and distorted relational estimates between variables caused by method designs. Studies on method bias have focused on "post hoc"…

This case study details the experiences of two researchers at a large university in the UK, in carrying out a series of cognitive interviews with students, to examine their interpretations of and responses to items on an institution-wide questionnaire. Cognitive interviewing refers to a set of techniques used to assess the ways in which…

This article reviews the methodologies used in 76 empirical studies conducted on creative thinking in primary school education and published between 2011 and 2021. The studies were analysed for their context, foci of investigation and the methodologies used. Each study was coded and analysed quantitatively and qualitatively. The findings are…

This essay presents the reflections of four Education Doctorate (EdD) students on the pilot testing strategies used during an online research methods course. Rigorous questionnaire and interview development skills are challenging to acquire. Pilot testing is an under-researched stage of instrument design, yet it is crucial to ensure validity and…

This case study provides insights into the effective design and administration of online questionnaires and interviews. The discussions and reflections are based on a research project carried out within the Middle East and North Africa region, investigating the growing status of English and its ramifications on the linguistic and educational…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

Background: Online crowdsourcing platforms, such as Amazon Mechanical Turk (MTurk), have become popular alternatives to the ubiquitous student samples used in psychology research. r/SampleSize, an alternative pool on the website Reddit, allows for online participant recruitment without compulsory or immediate payment, making it potentially useful…

A positive working environment and culture are essential for researchers as these enable them to conduct valuable, high-quality research. Yet, university staff frequently report their research culture as less than ideal. To understand researchers' experiences of research culture to inform tangible change, several surveys have been conducted by…

The reason for conducting the present case study was the problems the researchers encountered during data collection for another research project (Primary Study) entitled "The effects of virtual versus traditional flipped classes on EFL learners' grammar knowledge, self-regulation, and autonomy." Two online questionnaires were…

Recent years have seen a growing number of studies investigating the accuracy of nonprobability online panels; however, response quality in nonprobability online panels has not yet received much attention. To fill this gap, we investigate response quality in a comprehensive study of seven nonprobability online panels and three probability-based…

The National Center for Education Statistics (NCES) sponsors the National Teacher and Principal Survey (NTPS) on behalf of the U.S. Department of Education in order to collect data on public and private schools, principals, and teachers in the United States. The U.S. Census Bureau conducts the survey for NCES. The NTPS provides data on the…

Purpose: This article presents focus groups as a method to enhance questionnaire design to frame and test items for a mass survey on corruption and austerity in democracy. Such methodology lacks systematization when it comes to the description of implementation procedures and the discussion of effective contribution to the development of survey…

This study aims to investigate the trustworthiness of empirical research published in distance education (DE) journals, an area that has yet to be systematically explored. The review covers 238 empirical studies which were based on primary data and published in 2021 in eight DE journals listed in Social Science Citation Index (SSCI) or Emerging…

The paper outlines the author's experience employing the Delphi method, using as an example a particular application of the Delphi in the field of public transport research. Attention is given to aspects such as the choice of method, selection of experts, design of questionnaires, interaction between survey coordinator and participants, and also…

Since research integrity is not external to research but an integral part of it, it should be integrated into research training. However, several hindrances regarding contemporary research integrity education exist. To address them, we have developed a competency profile for teaching and learning research integrity based on four assumptions: 1) to…