Evaluations of vocational education and training (VET) programs play a key role in informing training policy in Australia and elsewhere. Increasingly, such evaluations use observational data from surveys or administrative collections to assess the effectiveness of VET programs and interventions. The difficulty associated with using observational…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Supplemental Educational Services (SES), a component of the No Child Left Behind (NCLB) Act, provides free tutoring to economically disadvantaged children who are attending Title I schools in their 2nd or more years of school improvement. This research evaluated SES in Tennessee to determine the: (a) impacts on student achievement, and (b)…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

This report reviews the ways in which statistical analysis can be used as a tool by vocational rehabilitation program managers to investigate the causes of problematic performance and generate strategies for corrective action. Two types of data collection are noted: operational studies and statistical data studies. Descriptions follow of two…

The goal of college preparation programs is to help students, particularly underrepresented students of color, to enroll and succeed in college. While many programs focus on strengthening students' math and reading skills, familiarizing them with college entrance exams, and demystifying the college admissions process, there are few guidelines for…

Based on an independent analysis of the data used to evaluate the Developmental Economic Education Program, questions are raised about the methodology and conclusions reached by Walstad and Soper in an article published in the Winter 1982 issue of the Journal. The original study is also defended in two replies. (Author/RM)

The data collection matrix makes possible the integration of functional area data from numerous assessment sources and presentation of the information in a unified composite report. This model is discussed in relation to the various assessment instruments and the evaluation of functional areas and programs in colleges and universities. (Author/MSE)

Stakeholder surveys are advocated as a panacea for many problems of needs assessment evaluation research utilizing surveys. Stakeholders are individuals who have a "stake" in the outcome of a needs assessment evaluation. Stakeholder surveys are appropriate for the predesign phase of a program evaluation. The surveys are often referred to…

When studying different types of returns to education, educational reforms are commonly used in the economics literature as a source of exogenous variation in education. The Swedish compulsory school reform is one example; the reform extended compulsory education throughout the country, in different municipalities at different points in time. Such…

This paper reviews analytic methods for estimating growth curves or developmental trajectories from longitudinal data. Traditional models for studying change are contrasted with a relatively new method, hierarchical linear models. Evidence is presented indicating that hierarchical linear models can overcome some of the methodological limitations…

This guide is designed to help educators plan and carry out evaluations of adult education programs. Following an introduction, Section 2 discusses how the evaluation process fits into the concept and normal cycle of program development. Section 3 describes the stages of the evaluation process, including needs assessment, program planning, process…

Research practitioners have traditionally collected and analyzed data using experimental designs and inferential statistical procedures. In addition to being difficult to learn and apply, these quantitative procedures generally leave out such variables as attitudes, feelings, and emotions. This paper describes the nature and role of qualitative…