This study investigates the effect of survey order in measuring self-reported cognitive load. Understanding how survey order influences responses is crucial, but it has been largely overlooked in the context of cognitive load. Using a 2 × 2 experimental design with 319 high school students, the study manipulated intrinsic cognitive load (ICL)…

Previous research on grid questions has mostly focused on their comparability with the item-by-item method and the use of shading to help respondents navigate through a grid. This study extends prior work by examining whether lexical similarity among grid items affects how respondents answer the questions in an experiment where we manipulated…

Grouped and right-censored (GRC) counts have been used in a wide range of attitudinal and behavioural surveys yet they cannot be readily analyzed or assessed by conventional statistical models. This study develops a unified regression framework for the design and optimality of GRC counts in surveys. To process infinitely many grouping schemes for…

The objective of our project was to develop a smartphone app for administering shorter ("modular") surveys. Given the paucity of research on this topic, we decided to use "co-design" techniques to generate design solutions. To implement these techniques, we recruited respondents in the survey target population to work in small…

Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in an experiment of three distinct survey designs…

Controlling unwanted annual bluegrass (Poa annua L.) in desirable turfgrass species often relies heavily on herbicide use. As a result, increasing populations of herbicide-resistant annual bluegrass have become a concern. In 2018, a university research and extension initiative began addressing the increasing herbicide-resistant annual bluegrass…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

Responsive survey design is a technique aimed at improving the efficiency or quality of surveys by using incoming data from the field to make design changes. The technique was pioneered on large national surveys, but the tools can also be applied on the smaller-scale surveys most commonly used by sociologists. We demonstrate responsive survey…

When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

This paper considers the ethical and practical issues of recruiting for, and administering a quantitative survey with marginalised populations. These issues were identified through a focus group discussion, which consolidated and expanded upon informal conversations held previously by five researchers about their experiences of conducting a…

In order to further understand the experiences of lesbian, gay, bisexual, transgender, queer-plus (LGBTQ+) youth, they must be identified in surveys and data at the federal, state, and local level. Being able to identify LGBTQ+ youth in data, particularly in surveys and research about school climate and negative school experiences, including…

Randomized experiments involving education interventions are typically implemented as cluster randomized trials, with schools serving as clusters. To design such a study, it is critical to understand the degree to which learning outcomes vary between versus within clusters (schools), specifically the intraclass correlation coefficient. It is also…

This study aimed to verify the applicability of the community of inquiry (CoI) survey instrument in MOOC involving 1,186 college students from 11 different disciplines in China. Exploratory factor analysis was used to explore potential factor structure models, and confirmatory factor analysis was utilized to verify the four-factor structure…

We have less time and focus than ever before, while the demand for attention is increasing. Therefore, it is no surprise that when answering questionnaires, we often choose to strongly agree or be neutral, producing problematic and unusable data. The current study investigated forced-choice (ipsative) format compared to the same questions on a…

Collecting data on lesbian, gay, bisexual, transgender, queer-plus (LGBTQ+) issues and the experiences of LGBTQ+ young people is essential both for enforcing civil rights protections and advancing racial, gender, and disability justice outcomes in K-12 education systems across the country. The absence of this data: (1) Is a barrier to full…