A new report published by the Buckeye Institute for Public Policy Solutions is a minor variant on six similar reports published by the Friedman Foundation over the past three years. The new report repeats some of the errors in the previous reports, and it follows a parallel structure, arguing that the costs of dropping out are dramatic for the…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Two inherently contradictory forces are pushing for reform in portfolio assessment. On the one hand there is a felt need for creating more rigid standards that operate to promote uniformity of ratings in appraisal practice to certify achievement. However, on the other hand, critical questions are being raised about separating acclaimed portfolio…

This experiment involved college students (N = 464) working on an authentic learning task (writing an essay) under 3 conditions: no feedback, detailed feedback (perceived by participants to be provided by the course instructor), and detailed feedback (perceived by participants to be computer generated). Additionally, conditions were crossed with 2…

Teacher preparation programs have continued to see the ever-increasing control of teacher candidates by policymakers. To control means to regulate. The problem, according to these authors, is that there are currently at least three regulating measurement and assessment obstacles faced by teacher candidates in teacher preparation programs. The…

Evaluation is important to public education and training programs if the United States is to be competitive in a global economy. Six major factors have had an impact on evaluation efforts: decreased financial resources, increased public dissatisfaction, changed management approaches, enhanced evaluation methods and procedures, redesigned…

Findings of a study that determined the ways in which practicing administrative course developers utilize instructional design activities in their design projects are presented in this paper. A survey was administered to 30 participants in a training and development group within a large organization and mailed to 43 other practicing instructional…

This digest recommends assessing all of a person's abilities, not just some. It also discusses self-report in the context of ability assessment. Current use of self assessment methodology taps more ability areas than existing ability or aptitude tests cover. Alternative testing approaches have been called for which enhance self-discovery and…

Many states have a disconnected body of laws regarding educator evaluation. Uncoordinated legislation can create problems with respect to evaluation, appropriate standards and methods to be employed, and implementation strategies. This paper describes Utah's educator-evaluation legislation to illustrate this phenomenon. Four statutory provisions…

Program design can aid problem-solving or decision-making tasks faced by evaluators. It can be used to facilitate evaluation planning through the definition of program boundaries and the generation and focusing of evaluation questions. Further, it can provide evaluation information about theoretical, historical, and political contexts of a…

This paper presents findings of a case study that documented the implementation of a portfolio assessment system in response to mandated program improvement and assessed its impact on teacher and student behaviors. The sample included elementary and middle school teachers and students from three Chapter 1 schools in a rural California school…

This briefing report on program evaluation notes that the new wave of family-centered, integrated services is forcing the field to rethink its methodology, and that the move towards outcome-driven reforms requires carefully defined outcomes and ways to measure them. Highlights of a seminar meeting held to explore these issues are included. The…

This report documents the National Assessment of Educational Progress (NAEP) special pilot study of group assessment. In 1994, NAEP administered U.S. History projects to a limited number of students. The purpose of this study was to investigate the feasibility of group assessment, and to gain practical experience in the design, development,…

A study developed criteria for judging state standards for the English language arts and reading and analyzed the 28 current standards documents. The criteria used for judging the standards relate to the purpose, audience, expectations, and assumptions of the standards documents; the organization of the standards; disciplinary coverage of the…