The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

The 4-H youth development organization is a complex public--private partnership between the U.S. Department of Agriculture's National Institute of Food and Agriculture, the nation's Cooperative Extension system and National 4-H Council, a private, nonprofit partner. The current article is focused on a partnership approach to the…

In this paper, we describe the design, development, and initial validity evidence for the Screening to Assign Accommodations Tool (SAAT). The purpose of the SAAT is to identify students for whom construct irrelevant variance (CIV) might obscure measurement of their knowledge, skills, and abilities in mathematics. Once students are identified as…

In January 2011, a Joint Committee of representatives from the U.S. Department of Education (ED) and the U.S. National Science Foundation (NSF) began work to establish cross-agency guidelines for improving the quality, coherence, and pace of knowledge development in science, technology, engineering and mathematics (STEM) education. Although the…

The aim of this study was to develop and validate an assessment tool for research consent competence in older participants. A four-item instrument was developed to assess the capacity of the older adults to consent to research. Data were obtained from 203 nursing home residents from two facilities and 201 community-dwelling older adults in a…

The purpose of this study was to develop a peer helping training program for university students in Turkey and to examine its effectiveness in improving the helping skills and self-growth of peer helpers. A pre-test, post-test, follow-up-test experimental design, involving a treatment and control group, was carried out with a total sample of 31…

This study examined the strategies employed by program administrators in historically Black colleges and universities (HBCU), as they negotiate sociopolitical interests in developing continuing higher education programs. Using a qualitative research design, the analysis was guided by the Cervero and Wilson adult and continuing education program…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

The Canadian Education Association (CEA) was commissioned by Hewlett-Packard Canada to create a case study describing the development, implementation and outcomes of New Brunswick's Dedicated Notebook Research Project. The New Brunswick Department of Education designed its research project to assess impacts on teaching and learning of dedicated…

Increased focus on assessment of student learning in the accreditation of higher education institutions offers new, challenging opportunities for institutional researchers. This article explores how institutional researchers can maximize these opportunities by offering methodological guidance in the assessment process and by designing new studies…

Prepared to stimulate discussion on how to design a Swedish policy in information science and technology, this report presents the state-of-the-art of this field as it pertains to the dissemination of scientific information and outlines a program for future research and development. The review portion examines systems for current information…

An experimental study of the impact of a prevocational literacy program on subsequent occupational education for military personnel yielded findings that led to a major redesign of the literacy program. (CT)

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)

Determining which program evaluations in developing countries are appropriate/feasible for randomized experiments to plan and evaluate social programs is discussed. Five threshold conditions are defined. Reviews of experiments from Barbados, China, Colombia, Kenya, Israel, Nicaragua, Pakistan, Taiwan, and the United States illustrate the issues…