The purpose of this study was to evaluate the combined effects of reduced equating sample size and shortened anchor test length on item response theory (IRT)-based linking and equating results. Data from two independent operational forms of a large-scale testing program were used to establish the baseline results for evaluating the results from…

Test disclosure legislation in New York State (LaValle Act) has had a major impact on the national testing programs administered by Educational Testing Services (ETS) for various sponsoring organizations. The paper reviews the immediate operational effects of test disclosure in the following areas: (1) increase in number of test forms developed;…

This module explains test review as it is now performed in most large-scale testing programs. It addresses the fundamental aspects of item review principally for fairness, sensitivity, and bias, and to a lesser degree for content and construct validity. The module is designed for a survey course and thus has a broad, rather than deep, focus. The…

Bias prevention activities undertaken as part of the development process for a major teacher certification testing program in Illinois are described. Because bias concerns were a major issue in planning and implementing the program, three distinct committees were formed to help prevent bias: (1) a bias review committee; (2) a content advisory…

This study was patterned after a previous study by Skaggs and Lissitz (1992) in which inconsistency of differential item functioning (DIF) was reported across test administrations. They suggested multidimensionality of test data as one possible reason for inconsistency. Therefore, in this study, DIF indices which were developed recently with a…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

The state of Nebraska has adopted a unique approach to statewide reporting that requires school districts to develop district-level assessments of the state student content standards or district standards comparable in quality and to report the results to the state and public. This system allows districts to base their assessments on what they are…

The new Elementary and Secondary Education Act amendments require states to begin annual testing in grades 3 through 8 in reading and mathematics by the 2005-2006 school year. Only 16 states currently have grade-by-grade tests in reading and mathematics, and only 9 of those have tests aligned with their standards, as the law requires. The rest of…

The report presents a screening and identification model for use with primary children to identify giftedness. The procedure is designed to be objective and employs multiple selection criteria. The Bayesian approach is used as it applies a probability methodology. The steps in instrument development include, among others, a review of the relevant…

This paper was presented with other papers in a forum dealing with statewide testing programs. The primary purpose of the paper is to address practical considerations and methods of resolution for large districts or states who are planning on conducting large scale testing or assessment programs with criterion or performance referenced measures.…

The comprehensive testing program used by the New York City Board of Examiners to develop tests for licensure of teachers is compared with national approaches to licensing. The first step in developing a licensing examination in New York is thorough job analysis leading to the preparation of task statements. These are used to develop lists of…

A review of relevant research reveals the general characteristics of a test of oral communication performance, some specific characteristics of testing programs, and some directions that future performance testing should take. Characteristics of tests of oral communication performance are as follows: (1) students should be able to apply the skills…

In the development of assessment for elementary students, little attention has been paid to the information exchange between student and tester. Analysis of the learning exchange requires developmental, diagnostic, and process information. Cybernetic assessment, a departure from standard testing techniques, involves the examiner in the information…

This paper makes the case that mandated tests, such as those administered through a state's accountability system, can best meet the goal of curricular reform by making their domains of learning targets transparent to users. Test maps are proposed as an effective device to accomplish that goal. A test map describes the content of the test and how…

This paper describes an assessment and evaluation effort occurring in the context of a middle school science curriculum development effort known as Learning by Design (LBD). The LBD approach builds on a body of cognitive science and professional education research that emphasizes learning from problem-solving experience. The assessment and…