The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

The purpose of this report is to provide descriptive data regarding the test scores of Milwaukee Parental Choice Program (MPCP) students in grades 4, 8 and 10 in reading, math, and science, as reported to the School Choice Demonstration Project 2008-2009. The tables, graphs, and histograms presented in this paper provide a snapshot of these…

An approach for clearer observation of differences when evaluating educational programs is presented. The standardized tests utilized in evaluating programs are designed to measure topics commonly taught and to maximize individual differences. This masks between-program differences and the unique aspects of different programs. Analysis of item…

The purpose of this report is to provide descriptive data regarding the test scores of Milwaukee Parental Choice Program (MPCP) students in grades 4, 8 and 10 in reading, math and science, as reported to the School Choice Demonstration Project 2007-2008. The tables, graphs, and histograms presented in this report provide a snapshot of these…

In assessing the validity of a norm-referenced model used in evaluating large-scale federal educational programs for disadvantaged children, gain estimates were shown as approximately equal with randomized control group model estimates compared by retrospective analyses of two databases. (Author/CM)

A review of evaluation forms designed to measure the effectiveness of teacher inservice workshops reveals the absence of a standardized, norm-referenced measurement instrument. The State of Texas Education Service Center (Region 20) has developed an instrument to meet the necessary research criteria. Applicability, ease of administration, and…

Because of misconceptions regarding appropriate measurement strategies, it is necessary to draw distinctions between two major measurement methodologies, norm-referenced and criterion-referenced measurement, as they relate to determining basic academic capabilities. Norm-referenced measures are used to ascertain an individual's performance in…

The author defines criterion-referenced (CRT) and norm-referenced (NRT) tests, considers current objections to each, and distinguishes their appropriate uses: CRTs for pupil diagnosis and instruction and NRTs for surveying achievement in a long-term evaluation context. Part of a theme issue on student assessment. (SJL)

Problems which arise when criterion referenced test results are used to evaluate the effects of an elementary school reading program are discussed. Topics include: alternative methods of analyzing test results, sensitivity of the instrument to program outcomes, and comparison of criterion referenced and norm referenced achievement test data.…

This report presents results of cognitive ability tests administered to 3 to 5-year olds who were graduating from Parent-Child Center (PCC) programs in 14 cities. PCC programs are designed to maximize the potentialities of low income preschoolers through in-center, home-based, or in-center/home-based combination programs. The findings reflected…

In the 1992-93 school year, in response to a request from the Board of Trustees of the Austin Independent School District (Texas) (AISD), the district's Office of Research and Evaluation conducted a retrospective examination of the 1991-92 AISD programs to determine cost-effectiveness when possible. This report describes the review process.…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

While much has been written on the topic of criterion-referenced testing and consequently its comparison with norm-referenced testing, measurement specialists have not as readily approached the subject of the implications involved in reporting such test information. The purposes of this paper are to (1) draw distinctions between criterion and…

In response to growing frustration over the lack of information about the national effectiveness of the Chapter 1 program, Congress enacted the Education Amendments of 1974. Section 151 of the Amendments directed the U.S. Office of Education to develop evaluation models that would allow school district data to be aggregated to provide national…

A discussion of second language program evaluation focuses on the interpretability of test scores as a criterion in program evaluation. It looks at both test design and research design issues. First, eight method-comparison, program evaluation studies that compare acquisition-based and analysis/practice based methods are described. Acquisition…