This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

This paper is one of a group that describes the research methodology for an evaluation of individually guided education (IGE) in American elementary schools. Described here are the procedures used to select the sample of schools being studied in the first phase of the evaluation. This phase was a large sample study that used structural equations…

The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…

An evaluation of Round One of a pilot study of a system for identifying effective youth organizations around the world is presented in this report. The report begins with a page of general observations about the successes and shortcomings of the pilot study, indicating that in general the study accomplished its objectives but that a need for…

In an effort to review the effectiveness and the impact of the Office of Institutional Research (OIR) at El Paso Community College (EPCC) and to identify and report any significant problems with the quality of service being provided to the college president and other key policy and decision makers, an evaluation plan and survey test instrument…

The recent conceptualization of organizations as "open" adaptive systems rather than "closed" systems has lead to increased interest in the relationship between the organization and its significant environmental influences. In order to study the perceived sources of internal (organizational) and external (environmental)…

A method of adjusting for bias due to nonresponse to an alumni survey is demonstrated, based upon analysis of data from both on-time and late respondents. The responses are opinions of 254 alumni regarding how they rate their recently completed program of study within a college of an urban university. As part of the university's curriculum review…

Issues associated with the evaluation of 61 educational curriculum units, which was conducted by the American Institutes for Research (AIR) are described. The units were adapted to the AIR Career Education Curriculum framework by creating 133 instructional units within which students could develop career skills in an orderly sequence. The…

The purpose of the workshop was to involve 30 vocational and technical teachers, supervisors, and administrators from eight states in activities to stimulate and enhance research activities. Presentations and handouts included: (1) "Vocational Education in the Decade Ahead--With Research Implications" by Ray E. Jongeward, (2) "Guidelines for the…

The impact of non-response (NR) in baseline data collection on the ability to analyze treatment effects in Project ALERT (Adolescent Experiences in Resistance Training) was studied. Project ALERT is a multisite, multiyear test of a smoking and drug prevention program for seventh and eighth graders. Questionnaires about drug use and related topics…

Designed to identify exemplary strategies and procedures for assessing employer satisfaction with former vocational education students' training and job performance, this handbook provides ideas for initiating such an assessment and for improving upon current assessment practices. It consists of five chapters. Chapter 1 provides an overview of the…

A study done for the National Community Education Advisory Council to assess programs funded under the Community Schools Act is presented in an introduction and three parts. Study goals, as defined in the introduction, are to describe the organization and operation of community education projects of local educational agencies, state educational…

This handbook is designed to help local and state vocational education evaluation personnel conduct studies to measure the training and job satisfaction of former vocational education students. It consists of eight chapters. Chapter 1 explains the rationale, development, and organization of the handbook. Chapter 2 is composed of two commissioned…