A method called multi-attribute utility analysis (MAUA) provides a decision-making framework that facilitates comparative analysis of multiple real-world decision alternatives with unique complex attributes. Utility analysis as a measure of effectiveness has been minimally used by educational researchers to date, despite clear relevance in complex…

This report presents an approach to evaluating networked improvement communities (NICs) and describes the tools used to apply the approach to a formative evaluation of the Minnesota Alternative Learning Center Networked Improvement Community (Minnesota ALC NIC). In fall 2019 leaders at the Minnesota Department of Education requested support from…

Minnesota Department of Education (MDE) collaborated with Wilder Research to conduct interviews with schools to understand how schools use their existing funding in order to sustain Multi-Tiered System of Supports (MTSS) implementation. The findings are presented in this report. Information on MDE's MTSS is included at the end of this report. MDE…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

Multi-Tiered System of Supports (MTSS) is an integrated system of high quality, standards-based instruction and interventions that are matched to students' academic, social-emotional, and behavioral needs. The framework relies on strong core instruction and layered tiers of supports for all needs of the whole child, with a focus on equity and…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…

How should colleges determine whether students are placed into developmental or college-level courses? Each year, colleges place millions of students into developmental math and English courses upon enrollment. To do so, colleges most often use a high-stakes placement test, which numerous research studies have shown to be highly inaccurate in…

Colleges throughout the United States are evaluating the effectiveness of the strategies used to decide whether to place students into college-level or developmental education courses. Developmental, or remedial, courses are designed to develop the reading, writing, or math skills of students deemed underprepared for college-level courses, a…

Historically, colleges have used standardized testing to determine whether a student is ready for college-level work or requires developmental courses first, but this method has been criticized as inaccurate. To obtain more accurate placements, nearly three-quarters of colleges now use multiple measures assessment (MMA) systems. These systems…

This report describes common and unique approaches that Regional Educational Laboratory (REL) Midwest Region states have adopted in developing and implementing their quality rating and improvement systems (QRISs). A QRIS is a method for assessing, improving, and communicating the quality of early childhood education and care providers. The study…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

While a good amount is known in education research about approaches to individualized learning (e.g. differentiated instruction, personalized learning plans), little is known about the scope and scale of efforts to individualize learning in the Bush Foundation's region of focus. To support its learning and future investments, the Bush Foundation…

In this article we describe the Graduate Review and Improvement Process (GRIP), an innovative evaluation process that makes student input central, now beginning its fifth year of implementation at the University of Minnesota. We begin by contrasting GRIP with traditional graduate program review, and we then explain the conceptual underpinnings of…

University of Minnesota educators use an integrated pest management (IPM) survey conducted during private pesticide applicator training as an educational, needs assessment, and evaluation tool. By incorporating the IPM Assessment, as the survey is called, into a widely attended program and using TurningPoint audience response devices, Extension…

From the 1980s to the present, educational accountability in the United States has grown dramatically. Such accountability in U.S. school districts, although driven primarily by external demands, has internal manifestations as well. The chapter traces the historical development of internal evaluation in American school districts, then highlights…