The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

In higher education, online students are often precluded from research assistantships that are more accessible for campus-based students. At a highly ranked institution for online learning, we developed the Undergraduate Research Program (URP) to address this gap in opportunities for online students. The URP is designed to engage fully distanced…

Interventions often require multiple decisions to improve outcomes for every student. Whether the decision to implement a practice, tailor an existing protocol, or change approaches, these decisions should be based on individual variables and outcomes via a sequence of treatment. To develop adaptive interventions that have sufficient evidence to…

The 4-H youth development organization is a complex public--private partnership between the U.S. Department of Agriculture's National Institute of Food and Agriculture, the nation's Cooperative Extension system and National 4-H Council, a private, nonprofit partner. The current article is focused on a partnership approach to the…

In January 2011, a Joint Committee of representatives from the U.S. Department of Education (ED) and the U.S. National Science Foundation (NSF) began work to establish cross-agency guidelines for improving the quality, coherence, and pace of knowledge development in science, technology, engineering and mathematics (STEM) education. Although the…

Business students are increasingly seeking international experience in short-term, study abroad programs to enhance their intercultural knowledge, intercultural communication skills, and global perspectives to be more competitive in the global arena. Intuitively, universities initiating these programs and the students sojourning abroad believe in…

A study was conducted to design valid and reliable self-evaluation instruments for periodic evaluation of academic programmes of Bolgatanga Polytechnic in Ghana, using evaluation experts and relevant stakeholders of the polytechnic. This paper presents some of the challenges, including those of institutional support, the technical demands of…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

Looks at past evaluation of compensatory education, suggests new approaches to evaluation, and makes recommendations about program implementation. (IRT)

Program directors and evaluators need to address the important program accountability question of attribution of outcomes. This discussion is a beginning. Starting with some basics, such as the meaning of the program, approaches to program theory development, and the nature of attribution, the paper suggests three types of attribution. An…

This paper deals with the problems of rigorous research within the dynamic organizational context. Definitions and axioms establish the natures of a social problem, a social intervention program, continuous program monitoring, a method of describing alternative treatments, treatment effect testing, and programmatic change. These definitions and…

An experimental study of the impact of a prevocational literacy program on subsequent occupational education for military personnel yielded findings that led to a major redesign of the literacy program. (CT)

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

Discusses the importance of occupational program reassessment in resource allocation and program planning. Provides suggestions concerning reassessment planning, goals, and systematic implementation. Recommends a reassessment structure that promotes objectivity. Identifies the areas that should be evaluated, and provides examples of measures of…

University students report significantly worse sleep quality than the general population. Sleep problems are related to increased health concerns, irritability, depression, fatigue, and attention and concentration difficulties, along with poor academic performance. Clinical research indicates that psychoeducational interventions are among the most…