Purpose: The purpose of this paper is to examine current approaches to interpretation of student evaluation data and present an innovative approach to developing benchmark targets for the effective and efficient use of these data. Design/Methodology/Approach: This article discusses traditional approaches to gathering and using student feedback…

Integrating evaluation into an Extension program offers multiple opportunities to understand program success through achieving program goals and objectives, delivering programming using the most effective techniques, and refining program audiences. It is less common that evaluation is used to guide and validate the effectiveness of program…

This brief report offers analysis of ACT and SAT results from 2008 to 2013 in the Southern Regional Education Board (SREB) region. The brief focuses on the increase in test participation rates and points to policies that SREB states initiated that affected these rates. Five SREB states currently require 100 percent student participation on the…

Test developers are responsible to define how test scores should be interpreted and used. The No Child Left Behind Act of 2001 (NCLB) directed the Secretary of Education to use results from the National Assessment of Educational Progress (NAEP) to confirm the proficiency scores from state developed tests. There are two sets of federal definitions…

When the Educational Testing Service became the administrator of the National Assessment of Educational Progress (NAEP) in 1983, it introduced scales based on item response theory (IRT) as a way of presenting results of the assessment to the general public. Some properties of the scales and their uses are discussed. Initial attempts at presenting…

Qualitative evaluation and quantitative evaluation are discussed, examining how the perspective of each can and should create a critical debate that encourages inquiry instead of hostility. To achieve the major goal of linking evaluation information to the organization's culture, the evaluator needs to use multiple methods in a responsive,…

This paper describes the basic concepts of linking educational assessments. Although it discusses statistical machinery for interpreting evidence about students' achievements, this paper's principal message is that linking tests is not just a technical problem. Technical questions can not be asked or answered until questions about the nature of…

Two case studies, a study of retention of health care personnel and a study of internal organizational communication, are presented that illustrate the application of multidimensional unfolding (MDU) and mapping to organizational concerns. This approach to multivariate analysis allows clients and stakeholders to picture the results of complex…

A scale was developed for measuring the persuasive impact of qualitative and quantitative evaluation reports on decision makers. Using two exploratory (n=192 graduate and undergraduate students) and two confirmatory (n=200 administrators) samples, researchers developed a 28-item Likert-type scale that demonstrated high reliability and validity.…

This paper discusses the experiences and insight derived from the 1985-1986 Statewide Evaluation of the Early Education Program of Handicapped Children in Louisiana, the multimethod evaluation of preschool intervention projects for handicapped and at-risk children. The program served almost 5,000 handicapped preschoolers and their parents,…

Three trends that are projected for the future of evaluation are greater use of evaluation research in litigation; increasing integration of the social and natural sciences for certain kinds of evaluation research; and a move away from conventional statistics toward data analysis. (SLD)

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

The purpose of this report was to explore one way in which quantitative and qualitative paradigms in program evaluation can be employed to reinforce each other. An evaluation was conducted of a large number of special education programs for preschoolers with handicaps in Louisiana. Since 1978, Louisiana has funded programs in 65 public school…

This paper presents the latest in a series of studies examining school district report cards. The purpose was to study the relationships among factors reported on school district report cards from Nevada high schools. The 44 categories reported on Nevada's 1993-94 report card represent the study's independent variables, grouped into the areas of…

This paper extends a series of studies examining school district report cards, which began with investigations of Tennessee's report card data. Since 1988, the Texas State Board of Education has produced a report card on each school district to report district-level data. Texas district report card items were organized into student outcome…