The article addresses the question of how the assessment process with large-scale data derived from online learning environments will be different from the assessment process without it. Following an explanation of big data and how it is different from previously available learner data, we describe three notable features that characterize…

As states and communities invest in initiatives to improve the quality of early care and education, the measurement of quality is becoming more widespread and the importance of measuring quality well is gaining increasing attention. Within the broad context of interest in improving quality, this report seeks to differentiate among a number of…

This technical report is the companion volume to the 1975 Databook, the purpose of which was the compilation of available data series focused on the organization and functioning of the knowledge production and utilization (KPU) system. This technical report is intended to (1) provide more accurate data sources, (2) analyze existing data sources,…

A basis is provided for judging the adequacy of evaluation plans or evaluation designs in this document. It is assumed that using the procedures suggested to determine the adequacy of evaluation designs in advance of actually conducting evaluations will lead to better evaluation designs, better evaluations, and more useful evaluative information.…

Schools are realizing that carefully collected and analyzed data represent the key to educational improvement. This digest outlines the most useful types of data to drive the school-improvement process, steps that must be taken to collect and analyze data, the role of administrators in guiding the data-driven reform process, and results that can…

Knowing and understanding the principles and tenets underlying dissemination, utilization, and impact collection facilitate the "how." Dissemination is a communication process involving interactional relationships among individuals. Involvement of multiple agencies gives rise to networking. Disseminating is also a major facet of planned…

One of a series of sixteen knowledge transformation papers, this paper deals with the nature and extent of use of evaluative data by administrators in vocational education. First, the following conditions which govern the use of the data are described: availability, reliability, credibility, utility, and consistency. Since the legitimacy of most…

The proposed program represents a vehicle whereby Minnesota can conduct a comprehensive assessment of the State's educational progress. It can provide a means of periodically monitoring achievement in the cognitive, affective, and psychomotor domains. The program is modeled after the National Assessment of Education Progress (NAEP), an ongoing…

Throwing the proverbial monkey wrench into the machinery "on paper" before a system begins functioning seems to be essential to program evaluation. This activity should be performed by the "resident skeptic" who is familiar with past resistance to change and who, being familiar with a program, is able to foresee theoretical and…