All educational testing is intended to have consequences, which are assumed to be beneficial, but tests may also have unintended, negative consequences (Messick, 1989). The issue is particularly important in the case of large-scale standardized tests, such as Australia's "National Assessment Program--Literacy and Numeracy" (NAPLAN), the…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

This report provides historical background on the origins, development and procedures, of Educational Testing Service's (ETS's) Board of Review. Established in 1969, the Board of Review makes final decisions for all test scores of questionable validity. ETS cancels or withholds scores believed to be invalid. Reasons for invalid scores range from…

Consideration is given to the degree of congruence between objectives and test items in the evaluation of objective-based testing. An analytic technique that measures congruence is described, and a bibliography is provided. (CK)

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…

This technical manual provides information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS), the assessment component of the Kentucky Education Reform Act Accountability System. The time period covered is Accountability Cycle 2, which spanned the school years 1992-93 through 1995-96. Sections of…

Due to a concern regarding the validity of Chicago public elementary schools standardized test scores on the Iowa Tests of Basic Skills, a test audit was conducted. The audit was limited to 40 schools. Two schools were selected from each of the 20 administrative districts, with each school testing one seventh- and one eighth-grade class. These…

This resource document represents the integration of both practice and theory related to minimum competency testing (MCT), and is largely based on information collected in a nationwide survey of MCT programs. Chapter 1, To Implement or Not to Implement MCT, by Marcy R. Perkins, presents a definition of MCT and a discussion of the perceived…

Two focus groups of test and measurement experts were held to explore the use of out-of-level testing for students with disabilities. The participants (n=17) included state and federal level assessment personnel, test company employees, and university professors. A content analysis of the narrative results indicated that there was no clear…