The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4)…

The authors discuss the use of surveys for collecting data from a population sample and emphasise the importance of being careful with the language of data collection. [For "The Data Files 5: Graphs for Exploring Relationships," see EJ1355504.]

Thanks to COVID-19, schools were closed and tests were canceled. The result is that we may not see test-taking data typically seen before. For some analyses, sample sizes may not meet the minimum requirement. For others, the sample of test-takers may be different from previous years. In some situation, there may be no data at all. What do we do in…

The Student Evaluation of Teaching (SET) instrument provides insight for instructors and administrators alike, often touting high response-rates to endorse their validity and reliability. However, response-rate alone omits consideration for "adequate quantity of 'observational sampling opportunity' (OSO) data points" (e.g., high student…

The PPIC Statewide Survey was inaugurated in 1998 to provide a way for Californians to express their views on important public policy issues. The survey provides timely, relevant, nonpartisan information on Californians' political, social, and economic opinions. It seeks to inform and improve state policymaking, raise awareness, and encourage…

The body of research in the field of postsecondary education and disability is wide ranging and continues to evolve. Specifically, the literature corpus includes contributions from a range of professions and a considerable number of journals. This breadth of diversity in perspective presents significant advantages; however, it also presents…

Spline growth modelling is a popular tool to model change processes with distinct phases and change points in longitudinal studies. Focusing on linear spline growth models with two phases and a fixed change point (the transition point from one phase to the other), we detail how to find optimal data collection designs that maximize the efficiency…

Focused ethnographies can have meaningful and useful application in primary care, community, or hospital healthcare practice, and are often used to determine ways to improve care and care processes. They can be pragmatic and efficient ways to capture data on a specific topic of importance to individual clinicians or clinical specialties. While…

Survey sampling is fundamentally an applied field. The goal in this book is to put an array of tools at the fingertips of practitioners by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This book serves at least…

Many out-of-school time programs want to learn more about how the children and youth they serve are faring. Outcome evaluations allow programs to do just that. This brief provides a basic review of outcome evaluations, discusses why they are important and when they are useful, and presents guidelines, strategies, and techniques for their use in…

The High School Longitudinal Study of 2009 (HSLS:09) is the fifth in a series of National Center for Education Statistics (NCES) secondary longitudinal studies. The core research questions for HSLS:09 explore secondary to postsecondary transition plans and the evolution of those plans; the paths into and out of science, technology, engineering,…

The use of Internet to aid research practice has become more popular in the recent years. In fact, some believe that Internet surveying and electronic data collection may revolutionize many disciplines by allowing for easier data collection, larger samples, and therefore more representative data. However, others are skeptical of its usability as…

The authors describe 2 efficiency (planned missing data) designs for measurement: the 3-form design and the 2-method measurement design. The 3-form design, a kind of matrix sampling, allows researchers to leverage limited resources to collect data for 33% more survey questions than can be answered by any 1 respondent. Power tables for estimating…

This document provides a summary and evaluation of the methodological procedures and results of the full-scale implementation of the Beginning Postsecondary Student Longitudinal Study Second Follow-up, 1990-94 (BPS:90/94). The study was conducted for the National Center for Education Statistics by Research Triangle Institute with the assistance of…