This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

Reviews a dozen basic questions about passing scores on state-mandated competency testing programs for students, teachers, administrators, and other education personnel. Condemns the "cardiac" approach (or traditonal 80 percent standard) in favor of procedures that systematically incorporate judgment with a variety of performance data.…

This report provides historical background on the origins, development and procedures, of Educational Testing Service's (ETS's) Board of Review. Established in 1969, the Board of Review makes final decisions for all test scores of questionable validity. ETS cancels or withholds scores believed to be invalid. Reasons for invalid scores range from…

The aim of this study was to evaluate the effect of disclosing a Scholastic Aptitude Test (SAT) form on the retest performance of examinees who initially had been tested with the disclosed form and subsequently retested with a different form. Retest performance was compared for three random samples of examinees who had been tested with the SAT as…

The effect of calculator type on student performance on a mathematics examination was studied. Differential item functioning (DIF) methodology was applied to examine group differences (calculator use) on item performance while conditioning on the relevant ability. Other survey questions were developed to ask students the extent to which they used…

Article presented a true story of how two cities ran testing programs and the lessons that can be learned from their failures. (Editor/RK)

Many testing programs include a section of optional questions in addition to mandatory parts of a test. These optional parts of a test are not often truly parallel to one another, and groups of examinees selecting each optional test section are not equivalent to one another. This paper provides a general method based on missing-data methods for…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

This is a descriptive study of the activities, statistics, and decisions made regarding the re-testing of six inner-city elementary schools, based on results of a norm-referenced achievement test given in the Cincinnati Public School district in April, 1985. Three statistical operations were performed on test data from the Design for School…

Specific recommendations are made concerning the circumstances under which the benefits of out-of-level testing outweigh the problems associated with it. Topics explored are: various methods for deciding when a set of test scores is invalid and the utility of these methods for local evaluators, the accuracy of vertical scaling, and the usefulness…

A standardized achievement testing program was begun in Alum Rock, California in the fall of 1972 as part of an evaluation of an Educational Voucher Demonstration. During each of the first three years of the demonstration both the form of test administration and the particular level of the standardized achievement test that a student is assigned…

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

The increased use of test scores as a measure of school quality is discussed. Legitimate and illegitimate practices of test preparation are considered. Some commercial test preparation programs are reviewed, with some conclusions about their effectiveness and desirability. (SLD)

After the 1984-85 evaluation of the Special Needs Project in the North York, Ontario Schools, it was decided to extend the standardized achievement testing for the 1985-86 school year. Because of previous test validity problems, testing was continued under more uniform conditions; practice tests were available and the achievement tests were…