Longitudinal change in the average Z scores for four groups of pupils sorted by quartiles was examined for its stability over three years. The data, collected from 1998 to 2009, was obtained from nine cohorts of Japanese junior high school pupils totaling 1,962 subjects. It showed illusionary declines among the mid-range pupils but improvements…

This digest discusses sources of error in testing, several approaches to estimating reliability, and several ways to increase test reliability. Reliability has been defined in different ways by different authors, but the best way to look at reliability may be the extent to which measurements resulting from a test are characteristics of those being…

Although agreeing that the System of Multicultural Pluralistic Assessment (SOMPA) has an important purpose, the author questions some perceived weaknesses: test validity; medical model measures; sociocultural scales; estimated learning potential (ELP); and the incompleteness of SOMPA manauls for use in evaluating the system. (See also TM 504 174).…

Many problems in the areas of test interpretation and educational assessment are causing difficulties for educators. On one hand the public and legislators are requesting more state testing programs and assessment programs, while on the other, educators realize the problems concerning testing and test interpretation. Difficulties arise when tests…

Study focused on the problems of curricular misalignment with placement tests used in community colleges. Findings indicate that while pre-test and post-test scores were highly aligned, there was little or no relationship between placement test scores and student performance in class, or between test content and skills emphasized in class. (PGS)

This paper considers some practical concepts and ideas related to standardized test score improvement in general and specifically to the World Institute for Computer-Assisted Teaching (WICAT) Integrated Learning System (ILS) use. Previous research cited in this paper shows that, while teachers are the most important variable in ILS utilization,…

A standardized achievement testing program was begun in Alum Rock, California in the fall of 1972 as part of an evaluation of an Educational Voucher Demonstration. During each of the first three years of the demonstration both the form of test administration and the particular level of the standardized achievement test that a student is assigned…

Examines the appropriateness of a cut-off score derived from the Angoff procedure for a reading test in the United Kingdom. Shows that the recommended cut-off score is too low. Suggests ways that standard setting might draw on a range of information to produce appropriate and rationally defensible cut-off scores. (DSK)

This guide--written for school administrators, teachers, counselors, parents, and the community--describes educational tests and measurements and test-related statistics. While specifically intended to help readers interpret the tests administered in the Los Angeles (California) Unified School District, this information may also be used to…

Since recent rises in standardized test scores have once again raised the possibility of cheating, there are a number of things which a school district should do to minimize the problem. These involve: (1) informing staff, students, and parents about appropriate and inappropriate test-taking and test-improvement skills; (2) providing staff and…

Due to a concern regarding the validity of Chicago public elementary schools standardized test scores on the Iowa Tests of Basic Skills, a test audit was conducted. The audit was limited to 40 schools. Two schools were selected from each of the 20 administrative districts, with each school testing one seventh- and one eighth-grade class. These…

For Title I evaluations, it may be appropriate to test out-of-level; that is, to override publisher's recommendations concerning the difficulty, length, and content appropriate for a particular grade. It is seldom necessary, however, to move more than one grade down. If the mean is substantially higher than the median, then some pupils will have…

A computer simulation procedure was developed to reproduce the overall pattern of results obtained in the Educational Testing Service Growth Study. Then simulated data for seven sets of 10,000 to 15,000 cases were analyzed, and findings compared on the basis of correlations between estimated and true growth scores. Findings showed that growth was…

The nature and common uses of standardized achievement tests are described and placed in context in order to evaluate claims and criticisms that are commonly made. Tests are described as samples of behavior and hence subject to sampling errors. Much of the debate is dominated by emotion and prejudices. There is very little empirical evidence about…

Twelve common errors which can invalidate an otherwise sound evaluation are identified, and ways to avoid them are presented. The hazards are: (1) grade-equivalent scores; (2) inappropriate statistical adjustments with nonequivalent control groups; (3) administering norm-referenced tests at inappropriate times of the school year; (4) inappropriate…