This article reports on the collaboration of six states to study how simulation-based science assessments can become transformative components of multi-level, balanced state science assessment systems. The project studied the psychometric quality, feasibility, and utility of simulation-based science assessments designed to serve formative purposes…

This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Describes the concept of "adequate yearly progress" as defined by the No Child Left Behind Act and discusses some of the psychometric issues it raises. Examines scaling as a means to equate tests when assessing educational gains and recommends vertically moderated standards over vertical equating of state assessments. (SLD)

Presents conclusions of an independent measurement expert that the Texas Assessment of Academic Skills (TAAS) was constructed according to acceptable professional standards and tests curricular material considered by the Texas Board of Education important for graduates to have mastered. Also supports the validity and reliability of the TAAS and…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

"Test Scoring" provides insight into psychometric procedures as used by a professional testing company or in large-scale projects. The book contains an overview of standard test theory, a discussion of factor analytic theory, and an exploration of special applications and problems. (SLD)

This brief makes the case for thoughtful district- or school-driven assessment systems that complement and go beyond what statewide testing systems are able to accomplish. It describes important attributes of model local assessment programs and presents the necessary steps for building a local assessment program that will elicit information that…

When the drive to develop and administer tests comes from a public call for accountability in a profession, from the government's response to this call, or from politicians attempting to identify a hot issue, it may be said that the test must first have political validity in order to be implemented. Only after this political validity has been…

This procedures manual for the North Carolina Test Development Program details the tasks involved in test development. The basic steps are described in an introductory section; they are (1) to specify the institutional objectives of the curriculum and ensure their instructional validity; and (2) to specify the characteristics, such as the purpose…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

The Delaware Student Testing Program (DSTP) is a mandated statewide assessment program that targets four core content areas. English language arts, including reading and writing, and mathematics are given to students in grades 3, 5, 8, and 10; science and social studies are given to students in grades 4, 6, 8, and 11. The DSTP reading and…

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)

The psychometric properties of the testing tools of the Michigan Educational Assessment Program (MEAP), the state standardized testing program, are examined. Reliability studies have indicated that the scores from the MEAP, ranging from 0.654 to 0.949, are generally acceptable. The State Department of Education offered supporting evidence for the…

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…

This technical manual provides information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS), the assessment component of the Kentucky Education Reform Act Accountability System. The time period covered is Accountability Cycle 2, which spanned the school years 1992-93 through 1995-96. Sections of…