Directed acyclic graphs (DAGs) are now a popular tool to inform causal inferences. We discuss how DAGs can also be used to encode theoretical assumptions about nonprobability samples and survey nonresponse and to determine whether population quantities including conditional distributions and regressions can be identified. We describe sources of…

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the…

Ethnoracial identity refers to the racial and ethnic categories that people use to classify themselves and others. How it is measured in surveys has implications for understanding inequalities. Yet how people self-identify may not conform to the categories standardized survey questions use to measure ethnicity and race, leading to potential…

Technology education research is a growing field, with the rate of growth increasing over the last 2 decades. As the field grows, it is paramount that credibility is maintained in published findings. To date there is no evidence to suggest a lack trust is warranted, however in the midst of the replication crisis there is need to ensure continued…

Likert-type item is the most popular response format for collecting data in social, educational, and psychological studies through scales or questionnaires. However, there is no consensus on whether parametric or non-parametric tests should be preferred when analyzing Likert-type data. This study examined the statistical power of parametric and…

Background: Speech-language pathologists often multitask in order to be efficient with their commonly large caseloads. In stuttering assessment, multitasking often involves collecting multiple measures simultaneously. Aims: The present study sought to determine reliability when collecting multiple measures simultaneously versus individually.…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

Researchers are combining self-reports from mobile surveys with passive data collection using sensors and apps on smartphones increasingly more often. While smartphones are commonly used in some groups of individuals, smartphone penetration is significantly lower in other groups. In addition, different operating systems (OSs) limit how mobile data…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

The nine appendices in this publication accompany the full report, "High School Longitudinal Study of 2009 (HSLS:09) Postsecondary Education Transcript Study and Student Financial Aid Records Collection. Data File Documentation. NCES 2020-004" (ED607366). They include: (1) Glossary of Terms; (2) Student Financial Aid Records Instrument…

Researchers attempting to survey refugees over time face methodological issues because of the transient nature of the target population. In this article, we examine whether applying smartphone technology could alleviate these issues. We interviewed 529 refugees and afterward invited them to four follow-up mobile web surveys and to install a…

Objective: To understand how missing data may influence conclusions drawn from campus sexual assault surveys. Methods: We systematically reviewed 40 surveys from 2010-2016. We constructed a pseudo-population of the total population targeted across schools, creating records proportional to the respective response rate and reported sexual assault…

Head Start is a national program that helps young children from families with low income get ready to succeed in school. It does this by working to promote their early learning and health and their families' well-being. The Head Start Family and Child Experiences Survey (FACES) provides national information about Head Start programs and…

Increasingly students, particularly those in the social sciences, work with survey data collected through a more complex sampling method than a simple random sample. Failing to understand how to properly approach survey data can lead to inaccurate results. In this article, we describe a series of online data visualization applications and…

This paper connects the technological practice of activity monitor gaming to the Next Generation Science Standards (NGSS) science and engineering practice of "analyzing and interpreting data," and to the foundational constructionist idea of personal meaning. In our larger study, eighth-grade students, ages 12-14, wore physical activity…