Sample representativeness is an important piece to consider when evaluating the quality of a screening assessment. If you are trying to determine whether or not the screening tool accurately measures children's skills, you want to ensure that the sample that is used to validate the tool is representative of your population of interest.

Large-scale education data are collected via complex sampling designs that incorporate clustering and unequal probability of selection. Multilevel models are often utilized to account for clustering effects. The probability weighted approach (PWA) has been frequently used to deal with the unequal probability of selection. In this study, we examine…

Dual-frame, random-digit-dialing (DFRDD) surveys, using a frame of landline telephone numbers and a frame of cell phone numbers, have become the norm for telephone surveys. Two alternative frame constructions sample exclusively from a cell phone frame, referred to as the 'single-frame cell,' and sample from the listed landline frame and the cell…

This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

This case study focuses on issues and dilemmas I faced when collecting data on a social networking site that enabled sociability, communication, and collaboration among teachers. To understand teacher online participation, I used an eclectic mixed-methods design with three phases to collect qualitative and quantitative data. This design allowed me…

The use of Consensual Qualitative Research (CQR) within counseling literature, specifically counselor education, has increased since 2013; however, the application of the method varies across counseling studies. Therefore, we used a modified content analysis to code 58 CQR counseling studies from 2003-2017 to examine whether and how each study…

Purpose: The purposes of this tutorial are (a) to describe a method of language sample analysis (LSA) referred to as SUGAR (Sampling Utterances and Grammatical Analysis Revised) and (b) to offer step-by-step instructions detailing how to collect, transcribe, analyze, and interpret the results of a SUGAR language sample. Method: The tutorial begins…

This paper introduces the Lang-Track-App, a smartphone application and backend system to aid second language acquisition researchers in implementing the experience sampling method (ESM). Surveying research participants with the Lang-Track-App multiple times per day can yield exceptionally rich data that can be analyzed in multiple ways. This…

This study compared the quality of survey data collected from Mechanical Turk (MTurk) workers and college students. Three groups of participants completed the same survey. "MTurk" respondents completed the survey as paid workers using the Mechanical Turk crowdsourcing platform. "Student Online" respondents also completed the…

Science education focuses on the methods of thinking about and using process skills rather than memorizing scientific facts. 5E educational model aims to learn by discovering scientific knowledge and engaging students in learning environments. The aim of this study was to examine the articles in the field of education related to the 5E educational…

Purpose: This study analyzes the content of doctoral theses completed in chemistry education within the last two decades (1999-2019) after the restructuring of education faculties in Turkey. This study examines the doctoral dissertations completed in chemistry education in 1999-2019 concerning their year of publication, university, objective,…

CCNetwork, in many cases, begins their work by assessing client needs--speaking with clients, examining current evidence and data, reviewing documents, and identifying patterns across those. Needs-sensing methods are important inputs to helping shape and prioritize what CCNetwork does. Landscape scans take these efforts a bit further by helping to…

This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

Purpose: Researchers now have more ways than ever before to capture information about groups of interest. In many areas, these are augmenting traditional survey approaches -- in others, new methods are potential replacements. This paper aims to explore three key trends: use of nonprobability samples, mobile data collection and administrative and…

Although the use of real-world data sets is encouraged when teaching statistics, it can be difficult for instructors to find meaningful data for introducing students to univariate descriptive statistics such as the mean, median, and percentiles. The recent lead contamination of the water supply in Flint, Michigan, provides a real-life data set…