The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

With the passage of 2005 Wisconsin Act 125, private schools participating in the Milwaukee Parental Choice Program (MPCP) are now required to administer a nationally normed standardized test annually in reading, mathematics, and science to their MPCP (a.k.a. "Choice") students enrolled in the 4th, 8th, and 10th grades. The law further…

The purpose of this report is to provide descriptive data regarding the test scores of Milwaukee Parental Choice Program (MPCP) students in grades 4, 8 and 10 in reading, math, and science, as reported to the School Choice Demonstration Project 2008-2009. The tables, graphs, and histograms presented in this paper provide a snapshot of these…

Investigated two variance estimation procedures on a normed test treated as a criterion-referenced test. The first estimation procedure estimated the standard deviation systematically higher, whereas the second procedure's estimation was systematically lower than the actual standard deviation. (Author/RC)

The preliminary draft of a formal program evaluation model for special education operations in Pennsylvania is presented. Beginning chapters provide a review of literature on norm-referenced measurement, an illustration of formal and informal program evaluation in a learning disabilities context, descriptions of general implementation strategies…

The purpose of this report is to provide descriptive data regarding the test scores of Milwaukee Parental Choice Program (MPCP) students in grades 4, 8 and 10 in reading, math and science, as reported to the School Choice Demonstration Project 2007-2008. The tables, graphs, and histograms presented in this report provide a snapshot of these…

Because of misconceptions regarding appropriate measurement strategies, it is necessary to draw distinctions between two major measurement methodologies, norm-referenced and criterion-referenced measurement, as they relate to determining basic academic capabilities. Norm-referenced measures are used to ascertain an individual's performance in…

This article examines what types of language tests are suitable in evaluating instructional programs in testing for educational accountability. Norm-referenced measurements are found unsuitable for this purpose; new, criterion-referenced tests must be developed. (CHK)

The author defines criterion-referenced (CRT) and norm-referenced (NRT) tests, considers current objections to each, and distinguishes their appropriate uses: CRTs for pupil diagnosis and instruction and NRTs for surveying achievement in a long-term evaluation context. Part of a theme issue on student assessment. (SJL)

Guidelines for evaluation of school programs in the State of Florida are presented. The purpose of evaluation is to modify the content and method of instruction, provide information to decision-makers and the public, provide feedback to participants, and determine criteria for program success. The optimal evaluation design for either innovative or…

The 1973 statewide (Maryland) educational accountability plan, for which this report was compiled, called for the development and establishment of statewide and local goals in reading, writing, and mathematics; a comprehensive and uniform statewide testing program; procedures for collecting data on student, home, community, and school…

Problems which arise when criterion referenced test results are used to evaluate the effects of an elementary school reading program are discussed. Topics include: alternative methods of analyzing test results, sensitivity of the instrument to program outcomes, and comparison of criterion referenced and norm referenced achievement test data.…

Review the progress and refinement of educational assessment during the past 40 years. Discusses the dynamic effects of the interaction between persons in various fields of educational practice and persons specializing in educational evaluation. Mentions adoption by the U.S. Army of psychological and educational tests for purposes of selection and…