Recent methods to improve generalizations from nonrandom samples typically invoke assumptions such as the strong ignorability of sample selection, which is challenging to meet in practice. Although researchers acknowledge the difficulty in meeting this assumption, point estimates are still provided and used without considering alternative…

First-generation college students are viewed as a group of at-risk individuals simply because their parents did not attend college. As a result, these students are at a higher risk of dropping out than other college students if their needs are not met. A number of researchers have conducted studies of first-generation college students in order to…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

The Early Childhood Educator Survey and the Early Childhood Administrator Survey allow users to collect consistent data on the use of child assessments and learning standards in early childhood learning settings. Each survey includes modules on educator/administrator background information, assessment use, and learning standards implementation.…

Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

Included here are two appendixes to "Adult Education Literacy Instruction: A Review of the Research." Appendix A, "Adult Studies," contains: (1) Assessment Profiles; (2) Alphabetics; (3) Fluency; (4) Vocabulary; and (5) Comprehension. Appendix B, "Adolescent Studies," contains: (1) Alphabetics; (2) Fluency; (3) Vocabulary; and (4) Comprehension.…

This article highlights the problem of omitted variable bias in research on the causal effect of financial aid on college-going. I first describe the problem of self-selection and the resulting bias from omitted variables. I then assess and explore the strengths and weaknesses of random assignment, multivariate regression, proxy variables, fixed…

Methodological and political issues arise during the designing, conducting, and reporting of campus-climate studies for LGBT students. These issues interact; making a decision about a methodological issue (e.g., sample size) has an impact on a political issue (e.g., how well the findings will be received). Ten key questions that must be addressed…

This article addresses the importance of obtaining a sample of an adequate size for the purpose of testing hypotheses. The logic underlying the requirement for a minimum sample size for hypothesis testing is discussed, as well as the criteria for determining it. Implications for researchers working with convenient samples of a fixed size are also…

The popularity of the sample survey in educational research makes it necessary for consumers to tell a good study from a poor one. Several sources were identified that gave advice on how to evaluate a sample design. The sources are either limited or too extensive to use in a practical sense. The purpose of this paper is to recommend six important…

This paper shares the findings of an inquiry that evaluated 50 survey articles published in a refereed journal, "Educational Administration Quarterly," by examining the 53 sample designs reported in the articles. The paper presents a typology of the sample designs identified, discusses the problems of sample selection and estimation…

Although single case studies might be useful to evaluators for a variety of purposes, there are no generally accepted ways for drawing inferences about the generality of findings from a case study. Single case studies are defined in this paper as either studies of single events, or disaggregated studies of multiple events. The data may be…

Identified are systematic visitor observation techniques to provide data to show visitors' reactions to interpretive programming. Use of this data should enhance the ability of the interpretive naturalists to plan, conduct, and evaluate interpretive programming. The suggested techniques can be accomplished without outside help, and can be…

Reviews factors that determine sample size, recommended sample sizes, recommended procedures for determining the appropriate sample size, and sample sizes reported in published and unpublished evaluations. (Author)