This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

Using data strategically to guide decisions and actions can have a positive effect on education practices and processes. This facilitation guide shows education data teams how to move beyond simply reporting data to applying data to direct strategic action. Using guiding questions, suggested activities, and activity forms, this guide provides…

Most assessment arguments are about measurement. When is it better to use direct versus indirect measures of student learning? Is one standardized test of critical thinking better than another? Is applying rubrics to student work better than using standardized tests? How valid are self-reported measures of learning? Although these arguments are…

Methodological and political issues arise during the designing, conducting, and reporting of campus-climate studies for LGBT students. These issues interact; making a decision about a methodological issue (e.g., sample size) has an impact on a political issue (e.g., how well the findings will be received). Ten key questions that must be addressed…

Colleges and universities invest time, personnel, and money into the process of student evaluations of faculty. These data provide only one measure of evaluating the quality and effectiveness of instruction. This research responded to the lack of emphasis on more effective use of the data for the purpose of improving teaching effectiveness by…

The research literature on screening and brief intervention (SBI) for unhealthy alcohol use is large and diverse. More than 50 clinical trials and 9 systematic reviews have been published on SBI in a range of healthcare settings, and via a variety of delivery approaches, in general practice, hospital wards, emergency departments, addiction…

Formative feedback systems live at the heart of systemic school improvement efforts. Without accurate and timely information on the results of intended interventions, school leaders and teachers fly blind in their efforts to link what they expect to what actually happens in their schools. This paper draws on the results of a 5-year National…

The ERS Standard for Program Evaluation encompass front-end analysis, evaluability assessment, formative evaluation, impact evaluation, program monitoring, and evaluation of evaluation. Written as simple admonitory statements, the Standards are organized into sections on formative and negotiation, structure and design, data collection and…

The Project on Secondary Analysis directed its attention to methodology and policy issues, focusing on reanalysis of existing data (1979-82)--surveys, program evaluations, etc.--as a vehicle for learning how to improve methods of obtaining and analyzing data, designing program evaluations, and constructing policy to enhance the quality and utility…

A communication theory paradigm typically is used to investigate the relationship between evaluation information and utilization: "Who says what, how, to whom, with what effects?" This study investigates the "how," or medium of presentation, aspect of the paradigm. (Author/LMO)

The six articles of this issue discuss the place of meta-analysis in the health professions and present two state-of-the-art meta-analyses using a variety of innovative methodologies, statistics, and secondary analytic procedures. A survey conducted for this issue and its sequel explores interventions to facilitate meta-analysis. (SLD)

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

Based on the analysis of 270 studies pertaining to audiences of the performing arts and visitors to museums, this critical review presents a social profile of the culture consuming public and evaluates the quality and usefulness of audience research. The review offers the following information arranged in four chapters: a description of the basic…

The California Healthy Kids Survey (CHKS) is a comprehensive youth health risk and resilience data collection service sponsored by the California Department of Education (CDE). This part of the guidebook will assist practitioners in understanding, interpreting, and deriving the maximum benefit from the CHKS results. It provides a basic road map…

Getting answers to questions about schools and student learning requires that educators know how to collect, analyze, and interpret data. Six critical steps in this process include: posing questions, establishing judgment criteria, making a plan, gathering data, analyzing data, and interpreting results. These steps can serve as a beginning guide…