This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

Distance writing programs still struggle with assessment strategies that can evaluate student writing as well as their ability to communicate about that writing with peers at a distance. This article uses Kim, Smith and Maeng's 2008 distance education program assessment scheme to evaluate a single distance writing program at Old Dominion…

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative…

This paper describes three multigrade school reforms in Latin America: (1) Colombia's "Escuela Nueva", (2) Guatemala's "Nueva Escuela Unitaria", and (3) Chile's MECE-Rural. Each reform endowed primary teachers and students with special training and instructional materials, and encouraged new kinds of instruction in rural…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Values and beliefs underlying assumptions concerning the independent evaluations of persons and programs involved in the educational process are discussed. Particular emphasis is placed on M. Scriven's treatise on bias in evaluation (1976). Works by E. R. House, R. E. Stake, L. Stenhouse, M. Parlett and D. Hamilton, and D. L. Stufflebeam are also…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

"How New York City's Charter Schools Affect Achievement" estimates the effects on student achievement of attending a New York City charter school rather than a traditional public school and investigates the characteristics of charter schools associated with the most positive effects on achievement. Because the report relies on an…

The evaluator's roles--change agent, manager, resource person, interpreter, and liaison between the project and the funding agency--are described, concerning the evaluation of innovative projects in education. Difficulties in obtaining desired commitments (i.e., a project's financial commitments and its positive attitude toward the evaluation…

The viability of persuasion theory as a framework for the assessment of program evaluation utilization was assessed. Independent variables studied included credibility, involvement, and role groups. More specifically, the research was designed to address three questions concerning: (1) the occurrence of peripheral involvement persuasive effects…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

While no one instrument can accurately evaluate or assess every college or university debate program, two separate frameworks can be established based in forensics and assessment literature. The first framework is a descriptive/analytic/evaluative framework for a debate program based on the philosophies of the several national conferences on…