Programme evaluation has developed tremendously over the past 50 years, with a proliferation of evaluation research, an increase in the institutionalization of evaluation, and growth in the professionalization of evaluation. However, existing research and developments are still largely in North America, Europe, Australia, and New Zealand, with…

The first step in the Validity and Reliability Study summarizes the history and purpose of California's quality rating and improvement system (QRIS), reviews findings from other QRIS evaluation studies, and describes the approach to validating the system in California. The majority of this report focuses on providing context for the California…

An educational environment characterized by shrinking fiscal and physical resources has spurred many institutions to undertake comprehensive academic program review. Such a process assesses the performance of programs and prioritizes them for de-emphasis, maintenance, or enhancement. How can applied learning be properly acknowledged within program…

The goal of this article is to contribute to the validation of a self-evaluation method, which can be used by schools to evaluate the quality of their Competence Assessment Program (CAP). The outcomes of the self-evaluations of two schools are systematically compared: a novice school with little experience in competence-based education and…

In the Information Communication Technology era teachers will have to wisely use the online environment in order to realize a new pedagogy. The penetration of the internet and collaborative online instruments to teaching and learning affect the quality of teaching. We have developed a digital indicator to evaluate the quality of the online tasks…

To ascertain if the descriptive criteria of the original Evaluation Scale of the City University of New York (CUNY) Writing Skills Assessment Test might be refined in the light of CUNY's 4 years of experience with large scale testing, a two-phase study was conducted over the period of 1 year, from May 1981 through June 1982, and involved nearly…

A study by Rothkopf is frequently cited as showing that educational experts are poor judges of the actual effectiveness of instructional materials. The study is replicated and comments from Ss are used to show that half-trained student experts tend to judge simple materials as more effective than complex materials. (Author)

Test data and error data indicate that a sample nonsensical program was highly effective. The feedback from conversations with Ss, however, condemned the program both on subject matter and teaching grounds. The program demonstrates that error rate and test data can be grossly misleading indicators of program quality. (Author)

Evaluates the research of Harste and Strickler (AA 525 393) and its rationales. (Author/RK)

A procedure for in-depth analysis of a limited number of tests being considered for selection by a school, district, project, or state personnel is described. This procedure involves listing the objectives that it would be desirable to measure determining the relative importance of each of these objectives, having "judges" match test items to…

The differentiated outcome hypothesis posits that the maximum effects of an educational program are realized along those dimensions emphasized in the program or in those central to the persons involved. The idea that educational programs employing unconventional means should be examined on outcomes that are consistent with those means is derived…

The criterion issues in the area of outcome research in psychotherapy were addressed and reviewed. Through this review of previous outcome research, it was determined that three basic criterion areas related best to traditional outcome variables such as therapist and community informant ratings, length of stay, and rehospitalization. These three…

The American College Testing Program (ACT) routinely evaluates the fit of its tests to the curriculum of high schools nationwide to ensure that what is being assessed reflects what is being taught as necessary for college success. This report describes the steps ACT has taken to ensure that the content foundations of the ACT Assessment Mathematics…

A brief discussion of the concept of validity, a description of the nature and purposes of the Iowa Tests of Educational Development (ITED), and a rationale for the inclusion of ITED results as part of the overall program evaluation of a secondary school are presented. According to the authors, the ITED can validly be used as one of the…

The purpose of this study was to determine the value of the Grotelueschen evaluation model in terms of six criteria: usability, comprehensiveness, cost-effectiveness, flexibility, validity, and objectivity. This evaluation process was chosen from six models that were reviewed to determine the effectiveness of an adult education program on career…