In education settings, treatments are often non-randomly assigned to clusters, such as schools or classrooms, while outcomes are measured for students. This research design is called the clustered observational study (COS). We examine the consequences of common support violations in the COS context. Common support violations occur when the…

Multilevel models are an increasingly popular method to analyze data that originate from a clustered or hierarchical structure. To effectively utilize multilevel models, one must have an adequately large number of clusters; otherwise, some model parameters will be estimated with bias. The goals for this paper are to (1) raise awareness of the…

Multilevel models are often used to evaluate hypotheses about relations among constructs when data are nested within clusters (Raudenbush & Bryk, 2002), although alternative approaches are available when analyzing nested data (Binder & Roberts, 2003; Sterba, 2009). The overarching goal of this article is to suggest when it is appropriate…

Meta-analyses are syntheses of effect-size estimates obtained from a collection of studies to summarize a particular field or topic (Hedges, 1992; Lipsey & Wilson, 2001). These reviews are used to integrate knowledge that can inform both scientific inquiry and public policy, therefore it is important to ensure that the estimates of the effect…

Educational researchers commonly use the rule of thumb of "design effect smaller than 2" as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models…

The use of evaluations for policy and program development and change is critically reviewed. Existing conceptions of utilization are discussed and improvements in the methods of detecting use are suggested. Five clusters of variables affecting utilization are described and hypotheses about the reasons for their effects are outlined. (Author/AL)

Eleven indexes of rurality and their effect on the classification of Michigan's 83 counties were investigated. The indexes were based on different concepts of rurality: (1) percent of employment in agriculture, fishing, and forestry; (2) population density and distance to urban centers; and (3) economic conditions. Index rankings were compared to…

Describes the conceptual model of newborn organization underlying the Brazelton Neonatal Behavioral Assessment Scale (NBAS). Argues that while the NBAS allows for the identification of an individual's behavioral repertoire, attempts to synthesize the resulting data have been plagued with difficulties. Briefly outlines an alternative model for…

This paper focuses on the use of the variable race in educational research. Researchers are clearly considered to have the right to choose their variables. But, the use of race in a nonscholarly fashion is held to be professionally inadequate and often detrimental to black Americans. For years, researchers using race to make comparison s between…