Separate selection and pretesting of students eliminate regression effects in the pre-post achievement gain measured in the RMC Model--A method of program evaluation. (CP)

This report describes a 1-week institute designed to upgrade research and evaluation skills of persons associated with PL 89-10 Title I and Title III projects. The institute's objectives were to illustrate and provide experience in: (1) operationalizing objectives of instructional programs; (2) designing projects with appropriate controls to allow…

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…

The effects of using different data analysis methods on estimates of treatment effects of educational programs were investigated. Various regression models, such as those recommended for Title I program evaluations, were studied. The first effect studied was the amount of bias that might be expected to occur in the various settings. Results…

Albuquerque's Title I evaluation staff is in the process of generating a comprehensive local evaluation design because it considers the federally required product evaluation unsatisfactory. The required mean-gain comparisons were extended beyond the dimension of program to the dimensions of school, grade, and Title I instructor. This evaluation…

The need for competent formal evaluation programs, particularly for new federally assisted programs, is expressed. Problems in defining educational evaluation and its requirements, in designing such evaluations, and 3 possible sources of faulty conceptual bases for evaluations, are presented. An attempt is made to define evaluation in general, to…

The equipercentile assumption states that students in traditional classrooms who receive no other instructional assistance, will maintain their relative rank order over time. To test this assumption, fall to fall test results on the SRA Achievement Tests were obtained for grades 2-3, and 6-7. Total reading and total mathematics growth scale values…

Twenty-six papers concerning Elementary and Secondary Education Act Title I program evaluation--presented at the 1978 American Educational Research Association/National Council on Measurement in Education meeting--are summarized. Speakers from the federal government are: C.T. Cross (see ED 156 695); R.L. Fishbein; and D. Ozenne. State department…

Meta-analysis of Title I program evaluations shows the norm-referenced model overestimates positive effectiveness; while the regression-discontinuity design underestimates it. Potential biases include residual regression artifacts, attrition and time-of-testing problems in the norm-referenced design, and assignment, measurement, and data…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Many difficulties are encountered when large-scale monitoring of federally-funded programs (including Title VII bilingual education programs) has been attempted. These difficulties may be categorized as follows: (1) differences in perception of the purpose of monitoring; (2) variance in the definition of the treatment (program) and expectations…

This report begins by considering the design of compensatory education evaluations. A professional evaluation of Elementary Secondary Education Act Title I must make a precise accounting of the relations among expenditures, implementation, outcome and impact; measure effectiveness over a long enough term to determine if the benefit and gain last;…

Seven considerations in designing the Title I Evaluation and Reporting System are reviewed: satisfying state, local, and federal needs; summative evaluation; differences in Title I subprograms; local use of different achievement tests; comparative analysis data; use of approved evaluation designs; and use of a common reporting metric. (MH)

An empirical study was conducted in order to obtain treatment effect estimates with the Special Regression model for groups in which there was no treatment. General mathematics test scores were obtained from 730 ninth graders in city schools somewhat similar to Title I schools, but in which no special treatments were given. Hypothetical…