Job Corps is the largest and most comprehensive education and job training program in the United States for young people ages 16 to 24 who are not in school and are not working. To deepen the Job Corps program's ability to generate and use evidence to improve the labor market trajectories of eligible young people, this report discusses ways Job…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

Extension education evaluators are concerned about accounting for lack of control over and the value of describing environmental influences when assessing impact. Evaluability assessment (EA) identifies relationships between and describes external influences on program events. It provides information regarding clarity about goals and objectives…

This study proposed to identify and report current programs of student follow-up at 16 Illinois and 24 non-Illinois public junior colleges. Plans and recommendations are given for improving follow-up programs in Illinois. The author concluded that (1) the purpose of follow-up is to evaluate and improve the institution's performance; (2)…

Review of solicited gifted program evaluation reports and the literature found a relative paucity of such reports as well as a lack of methodological sophistication, reporting, and utility concerns. Promising practices were seen in some evaluations conducted for program improvement, which employed multiple methodologies, sources, analysis…

There is a need for a set of organizing principles that will provide a clear rationale for the field of program evaluation. It is contended that the concept of evaluation promoted by Ralph W. Tyler, pioneer in the field, suggests such a set of principles. Data were derived from a two-year prescriptive case study of Tyler's contributions through…

Describes the Instructional Quality Inventory (IQI) for formative evaluation of systematically developed instructional programs, its classification scheme for objectives and test items, and procedures for checking programs for adequacy, consistency and presentation. Accounts of two studies are given to support the usefulness of the IQI. (EAO)

Distance educators participated in a Delphi study to identify and rank future research and evaluation needs/issues. The study focused on planning for distance education; structuring decisions required for distance education; the implementation process; and evaluation needs in documenting outcomes. Four themes emerged: cooperation and collaboration…

Impact must be defined before it can be assessed. Part of the definition is that impact is the consequences of funded vocational education research and development projects and programs, not just the fact of the dissemination of the products of the projects. Programs are defined as a group of funded research and development improvement projects…

An ethnographic paradigm was used to collect the needed information on effective Right to Read program planning and staff training in several New York school districts. The paradigm encompassed six steps: determining program goals and objectives, completing needs assessment, determining planning strategies, writing and accepting the plan,…

An experiment designed to determine the aptitude level(s) and group size which would provide optimal feedback for formative evaluation of instructional materials found that revisions based on feedback from one-to- one sessions with a mixed aptitude group were more effective than those based on feedback from a group or single aptitude level. (EAO)

Evaluation, as currently practiced in vocational education, may not contribute to program improvement; in fact, it may be counterproductive. Rather than asking how evaluations can be improved, it might be better to ask if a relationship does, in fact, exist between evaluation and program improvement and, if such a relationship exists, what new…

This paper presents a model for continuous, systematic evaluation of ongoing programs and specifies data needed for decisionmaking in the areas of program adoption, curtailment, or expansion. These data give the decisionmaker the necessary information for program planning in today's sophisticated educational environment. (Author/RA)