The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

The 4-H youth development organization is a complex public--private partnership between the U.S. Department of Agriculture's National Institute of Food and Agriculture, the nation's Cooperative Extension system and National 4-H Council, a private, nonprofit partner. The current article is focused on a partnership approach to the…

The aim of this study was to develop and validate an assessment tool for research consent competence in older participants. A four-item instrument was developed to assess the capacity of the older adults to consent to research. Data were obtained from 203 nursing home residents from two facilities and 201 community-dwelling older adults in a…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

Increased focus on assessment of student learning in the accreditation of higher education institutions offers new, challenging opportunities for institutional researchers. This article explores how institutional researchers can maximize these opportunities by offering methodological guidance in the assessment process and by designing new studies…

This report presents the key findings and recommendations of the Advisory Panel for the Head Start Evaluation Design Project. The principal audiences for the report are: (1) leadership and staff of the Administration for Children, Youth, and Families (ACYF) who have administrative responsibility for Head Start; and (2) local Head Start programs.…

This book was written to help educators plan and conduct an assessment of students' educational needs. Chapters regarding information on planning, implementing, analyzing and reporting the results, and making decisions based on the results are included. Political implications for both education and community groups are discussed. Practical,…

Looks at past evaluation of compensatory education, suggests new approaches to evaluation, and makes recommendations about program implementation. (IRT)

Program directors and evaluators need to address the important program accountability question of attribution of outcomes. This discussion is a beginning. Starting with some basics, such as the meaning of the program, approaches to program theory development, and the nature of attribution, the paper suggests three types of attribution. An…

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

Discusses the importance of occupational program reassessment in resource allocation and program planning. Provides suggestions concerning reassessment planning, goals, and systematic implementation. Recommends a reassessment structure that promotes objectivity. Identifies the areas that should be evaluated, and provides examples of measures of…

The concept of Levels of Use of the Innovation (LoU) permits an operational, cost-feasible description and documentation of whether or not an educational innovation or treatment is being implemented. Eight different LoU's can be reliably measured: nonuse, orientation, preparation, mechanical uses, routine, refinement, integration, and renewal.…

This paper examines (1) the problems of program design and implementation in relation to evaluation design, the confusion between research and evaluation design, and the overemphasis on quantitative data; (2) clarifies misconceptions about these problems and the evaluation process; and (3) suggests ways of avoiding these problems in the future.…

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)

Useful as a classroom text and self-teaching tool, this book outlines the process of designing and reporting action research projects in schools. The underlying assumption of the book is that research is not a domain that belongs only to academics, but is a powerful approach that can be used by practitioners to contribute to school renewal and…