Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4)…

When using multiple imputation, users often want to know how many imputations they need. An old answer is that 2-10 imputations usually suffice, but this recommendation only addresses the efficiency of point estimates. You may need more imputations if, in addition to efficient point estimates, you also want standard error (SE) estimates that would…

Researchers have become increasingly interested in better understanding the survey data collection process in interviewer-administered surveys. However, tools for analysing paradata capturing information about field processes, also called call record data, are still not yet fully explored. This paper introduces sequence analysis as a simple tool…

This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

CCNetwork, in many cases, begins their work by assessing client needs--speaking with clients, examining current evidence and data, reviewing documents, and identifying patterns across those. Needs-sensing methods are important inputs to helping shape and prioritize what CCNetwork does. Landscape scans take these efforts a bit further by helping to…

In this chapter, we review the strengths of NCES survey data, provide an example of analyzing NCES survey data to explore the pathways between coursework in career and technical education in high school and postsecondary success, and offer suggestions for future data collection.

Descriptive analyses of socially important or theoretically interesting phenomena and trends are a vital component of research in the behavioral, social, economic, and health sciences. Such analyses yield reliable results when using representative individual participant data (IPD) from studies with complex survey designs, including educational…

To speak to diverse audiences about how people learn to write and how writing works inside and outside the academy, we must conduct research across geographical, institutional, and cultural contexts as well as research that enables comparison when appropriate. Large-scale empirical research is useful for both of these moves; however, we must…

This guide describes a five-step collaborative process that educators can use with other educators, researchers, and content experts to write or adapt questions and develop surveys for education contexts. This process allows educators to leverage the expertise of individuals within and outside of their organization to ensure a high-quality survey…

The Responses to Educational Disruption Survey (REDS), conducted by the International Association for the Evaluation of Educational Achievement (IEA), studied how teaching and learning were affected by the disruptions caused by COVID-19 and aimed to paint a picture of national responses to the global pandemic. REDS was based on the premise that…

Data can be a powerful tool for self-evaluation, goal setting, and advocacy in the school library. Regardless of the grade level or the size of the student body, any school library has meaningful data to mine and learn from. Basic data such as circulation numbers can impact a myriad of areas relevant to student learning such as collection…

Most state departments of education across the United States recommend or require that districts use a home language survey as the first step in a multistep process of identifying students who qualify for English learner student services. School districts typically administer the home language survey to parents and guardians during a student's…

Data collected from surveys can result in hundreds of variables and thousands of respondents. This implies that time and energy must be devoted to (a) carefully entering the data into a database, (b) running preliminary analyses to identify any problems (e.g., missing data, potential outliers), (c) checking the reliability and validity of the…

This paper presents best practices for conducting survey research using Amazon Mechanical Turk (MTurk). Readers will learn the benefits, limitations, and trade-offs of using MTurk as compared to other recruitment services, including SurveyMonkey and Qualtrics. A synthesis of survey design guidelines along with a sample survey are presented to help…

This essay describes Rasch analysis psychometric techniques and how such techniques can be used by life sciences education researchers to guide the development and use of surveys and tests. Specifically, Rasch techniques can be used to document and evaluate the measurement functioning of such instruments. Rasch techniques also allow researchers to…