This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Recently, Northwest Evaluation Association (NWEA) completed a study to connect the scale of the Minnesota Comprehensive Assessments (MCA) Testing Program used for Minnesota's mathematics and reading assessments with NWEA's RIT (Rasch Unit) scale. Information from the state assessments was used in a study to establish performance-level scores on…

This handbook outlines procedures for sharing student data between schools and the Ministry of Education, and answers questions pertaining to provincial examinations. It supports the work of both educators and the Ministry, which works with schools to produce transcripts and administer provincial exams. The following are appended: (1) Forms; and…

This paper addresses issues of vertical equating for the Arkansas Comprehensive Testing, Assessment and Accountability Program (ACTAAP) assessments as they relate to school accountability and determination of Adequate Yearly Progress (AYP) as required by the recent federal legislation, the No Child Left Behind Act. The paper first provides a brief…

Describes the concept of "adequate yearly progress" as defined by the No Child Left Behind Act and discusses some of the psychometric issues it raises. Examines scaling as a means to equate tests when assessing educational gains and recommends vertically moderated standards over vertical equating of state assessments. (SLD)

Linking scores from the National Assessment of Educational Progress (NAEP) to statewide test results was studied. Results based on an equipercentile procedure suggest that such a link does not provide precise information. Information from a linking study should be limited to rough estimates of students in each NAEP achievement level. (SLD)

The Maryland Functional Testing Program (MFTP) uses the Rasch model as the statistical framework for the analysis of test items and scores. This paper is designed to assist the reader in developing an understanding of the fit statistics in the Rasch model. Background materials on application of the Rasch model in statistical analysis of the MFTP…

This paper is the first of a series that will compare estimates of error that arises when state assessments are linked to the National Assessment of Educational Progress (NAEP). Different forms of linkage are discussed. Comparisons are made between whole-sample regression, repeated half-sample replication, bootstrap, and jackknife estimates of the…

The adequacy of linking statewide standardized test results to the National Assessment of Educational Progress by using equipercentile equating procedures was investigated using statewide mathematics data from four states. Results suggest that the linkings are not sufficiently trustworthy to make comparisons based on the tails of the distribution.…

Rasch model statistics and domain-referenced test development methods were used in the Virginia Basic Learning Skills (BLS) testing programs and the Graduation Competencies testing program in order to increase the fairness and effectiveness of those programs. Mastery of each of the 83 objectives in reading and mathematics for grades one through…

A socially moderated link was established between statewide achievement results and the National Assessment of Educational Progress (NAEP) by using the same achievement level descriptions in an Iowa Test of Basic Skills standard-setting and an NAEP standard setting study. A statistically moderated link was established through an equipercentile…

Recently, several states have expressed interest in linking their statewide assessments to the National Assessment of Educational Progress (NAEP) in the hope that, through equating, they can be compared to national results. This study considers the degree to which existing statewide assessments may be linked to NAEP, without violating the basic…

This study was designed to illustrate the use of the Rasch model procedure to equate the Dade County Compensatory Education Skills Test (DCCEST) to the State Student Assessment Test (SSAT) for both mathematics skills and communications skills. The SSAT was a test developed by the Florida State Department of Education to measure students' level of…

This study investigated the feasibility of the use of the three-parameter item response theory (IRT) model in Florida's minimum competency testing program. The paper includes the following sections: (1) a description of the procedures currently being used by the assessment program, with an emphasis on procedures currently involving the Rasch…

This digest is designed to provide information to Texas testing coordinators, other educators, and interested citizens about the development procedures and technical attributes of the state-mandated criterion-referenced assessment program. The chapters are: (1) "Background"; (2) "Test Development"; (3) "Test…