This report, which is based on an invited presentation given at the 2015 meeting of the Association of Test Publishers, is a response to the continuing proliferation of scale linking studies that have occurred since the publication of "Uncommon Measures" in 1999.The report has four parts. First, I restate the conclusions made in…

The Center on Enhancing Early Learning Outcomes (CEELO) was asked to provide information on how other states are approaching the development and implementation of Kindergarten Entry Assessment (KEA) as part of a comprehensive assessment system. Specifically, the request asked for information about KEA measures used by other states, the processes…

Since the passage of No Child Left Behind, large-scale assessments have come to play a central role in federal and state education accountability systems. Teachers and parents have expressed a number of concerns about their state testing programs, such as too much time devoted to testing and the high-stakes use of testing for teacher evaluation.…

Recently, Northwest Evaluation Association (NWEA) completed a study to connect the scale of the Minnesota Comprehensive Assessments (MCA) Testing Program used for Minnesota's mathematics and reading assessments with NWEA's RIT (Rasch Unit) scale. Information from the state assessments was used in a study to establish performance-level scores on…

The purpose of this paper is to provide information and insight into how state assessment programs are governed, how individual state and state-consortium assessment programs actually operate, and how key policy and technical decisions on these programs are made. To address these issues, this paper is divided into three sections: First, the New…

State-level testing programs continue to grow, and the challenge of validation does not wane. Although more than a decade has passed since the 1999 Joint Standards for Educational and Psychological Testing set out a call for the organization of validity evidence into validity arguments, practical examples of such arguments are not readily…

This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

To determine the factors that contribute to or compromise the effectiveness of multiscored items, this study combined analysis of statewide score data from the 1996 Maryland School Performance Assessment Program tests with systematic analyses of 60 activities providing measures of writing, language usage, or both, and one or more content areas.…

Explores three issues to consider regarding statewide standardized tests in higher education: (1) existing statewide testing programs differ markedly from one another in nature and objectives, and it's important to know specifically how and why; (2) a range of substantial implementation issues will be present; and (3) there are promising…

Considered recommendations made by R. Linn (2000) and made a preliminary determination of the degree of cohesion between the Arkansas Comprehensive Testing, Assessment, and Accountability (ACTAAP) program and those recommendations. The ACTAAP appears to be an exemplary program in the early stages of development. (SLD)

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

Linking scores from the National Assessment of Educational Progress (NAEP) to statewide test results was studied. Results based on an equipercentile procedure suggest that such a link does not provide precise information. Information from a linking study should be limited to rough estimates of students in each NAEP achievement level. (SLD)

This policy brief highlights findings from an annual review of how far states' work on standards has progressed over the years and a determination of how much work remains to be done. Information was collected from state departments of education and interviews with state officials. Since 1995 there has been a steady rise in all aspects of…

The attempt by D.Edwards and C. B. Cummings to adjust state mean Scholastic Aptitude Test Scores for differential participation rates with a "fuzzy truncation model" satisfies three criteria the authors previously defined but falls short for two. Omission of sensitivity studies mars the otherwise exemplary study. (SLD)

Investigated how well the generalized and Rasch models described item and test performance across a broad range of mixed-item-format test configurations (six tests from two state proficiency testing programs). Evaluating the impact of model assumptions on the predictions of item and test information permitted a delineation of the implications of…