Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In…

The application of mathematical programming techniques is extended to the construction of measurement instruments in generalizability theory. Key concepts in generalizability theory are explained and a description is given of: (1) the one-facet crossed design; (2) the two-facet crossed design; and (3) a two-facet nested design. The optimization of…

Magnitude of effect measures (MEMs), when adequately understood and correctly used, are important aids for researchers who do not want to rely solely on tests of statistical significance in substantive result interpretation. The MEM tells how much of the dependent variable can be controlled, predicted, or explained by the independent variables.…

The framework and procedures of generalizability theory are introduced and illustrated in this instructional module that uses a hypothetical scenario involving writing proficiency. Generalizability analyses are useful for understanding the relative importance of various sources of error and for designing efficient measurement procedures. (SLD)

The findings of the Cost, Quality, and Child Outcomes (CQO) study in Child Care Centers, the largest and most visible child care research conducted in the 1990s, were widely publicized and used to promote increased spending on initiatives to improve child care quality, the redesign of subsidy systems to provide quality incentives, more stringent…

This book provides conceptual and practical strategies for the data and information collection and analysis needs of a diverse group of institutions, ranging from small rural community colleges to large urban research institutions. The model framework is designed for use by any size or type of institution and gives a broad overview of various…