In web surveys, no interviewer is present to clarify question comprehension problems, which can be particularly prevalent among respondents with low literacy skills. Although plain language is used in various contexts to improve text comprehensibility, its use in social science questionnaires has not been investigated to date. Using a…

Probes are follow-ups to survey questions used to gain insights on respondents' understanding of and responses to these questions. They are usually administered as open-ended questions, primarily in the context of questionnaire pretesting. Due to the decreased cost of data collection for open-ended questions in web surveys, researchers have argued…

Online surveys are widely used in social science research as well as in empirical studies of open, online, and distance education. However, students' responses are likely to be at odds with their actual behavior. In this context, we examined the discrepancies between self-reported use and actual use (i.e., learning analytics data) among 20,646…

The National Center for Education Statistics (NCES) sponsors the National Teacher and Principal Survey (NTPS) on behalf of the U.S. Department of Education in order to collect data on public and private schools, principals, and teachers in the United States. The U.S. Census Bureau conducts the survey for NCES. The NTPS provides data on the…

Family income questions in general purpose surveys are usually collected with either a single-question summary design or a multiple-question disaggregation design. It is unclear how estimates from the two approaches agree with each other. The current paper takes advantage of a large-scale survey that has collected family income with both methods.…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

Expected yield rates are essential to a survey's data collection plan, as they inform requisite sample sizes to meet the survey's objectives. Given an overall expected yield rate for a self-administered mail survey, this short take describes a simple method for using the Census Planning Database to assign differential yield rates to lower-level…

Even small monetary incentives, e.g., a one-dollar bill in a postal invitation letter, can increase the response rate in a web survey. However, in the euro currency area, the smallest amount of monetary incentive for a postal invitation is a five-euro bill, which is costly. As such, we conducted a random experiment with prepaid stamp and postcard…

Using secondary data has many advantages, but there are also many limitations, including the lack of relevant information. This article draws on a previous study that used secondary data to investigate substance use in young, elite athletes. Three types of missing data appeared: missing data, lack of information about the data collection process,…

The present study used quantitative and qualitative measures to examine Iranian applied linguists' (mis-) conceptions of ethical issues in research. For this purpose, one hundred and twelve applied linguists completed a research ethics questionnaire constructed and validated by the researchers. In the follow-up qualitative phase, 15 applied…

Many countries rely on statements issued by professional associations to delimit the scope of school psychological practice. It is, however, not always clear to what extent these statements match current practices and school psychologists' self-perception of their professional role, as empirical data is often unavailable or limited. This study…

This academic article provides the essential steps for designing an effective English questionnaire in social science research, with a focus on ensuring clarity, cultural sensitivity and ethical integrity. Developed from key insights from related studies, it outlines potential practice in questionnaire design, item development and the importance…

This article presents the results of a general population study that used three different modes of data collection administered sequentially. The study began with a letter that contained the link to an online survey. Those who did not respond were interviewed by phone or face-to-face. The article focuses on the cost of the study related to…

Introductory undergraduate statistics courses widely focus on statistical concepts or software-based data analysis. Despite the fact that the analysis of real data has shown to enhance students' engagement, the step of data collection is often neglected. Once students know the challenges of data collection, they are more aware of potential…

The IEA's International Civic and Citizenship Education Study (ICCS) investigates the ways in which young people around the world are prepared to undertake their roles as citizens. This report presents the European results from the third cycle of the study (ICCS 2022). Eighteen countries and two benchmarking participants (the German states of…