State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In this article we address the issue of consistency in standard setting in the context of an augmented state testing program. Information gained from the external NRT scores is used to help make an informed decision on the determination of cut scores on the state test. The consistency of cut scores on the CRT across grades is maintained by forcing…

Large data sets from a state reading assessment for third and fifth graders were analyzed to examine differential item functioning (DIF), differential distractor functioning (DDF), and differential omission frequency (DOF) between students with particular categories of disabilities (speech/language impairments, learning disabilities, and emotional…

Describes the procedures by which Kentucky's state assessment program synthesized results from three standard setting procedures (Contrasting Groups, Bookmark, and Jaeger-Mills) for the 2000 state assessment. Shows the value of using multiple standard-setting approaches to gather information from each. (SLD)

How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

Examined the education indicators used in the "Quality Counts" report published by Editorial Projects in Education in 1998. Discusses the degree to which persuasive or normative uses stemmed from the value judgments being made on the basis of the indicator data. (SLD)

The Connecticut Assessment of Educational Progress assesses writing traits using different approaches to diagnose students' skills. These include multiple choice, direct assessment, "revising test," dictation, and note-taking. These measures and scoring guides are used to assess several elements of good writing. (DWH)

The history of direct writing assessment and scoring procedures in South Carolina are discussed. The South Carolina Basic Skills Assessment Program Writing Committee developed writing objectives for students. Holistic and analytic scoring procedures were used. Information on instructional improvement and student deficiencies was distributed to…

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

Examined a scoring anomaly that became apparent in a state-mandated writing assessment. Results for 3,660 essays by sixth graders show that using a spiral model for training raters and scoring papers results in higher mean ratings than does using a sequential model for training and scoring. Findings demonstrate the importance of making decisions…

The relationships between ratings on the Idaho Alternate Assessment (IAA) for 116 students with significant disabilities and corresponding ratings for the same students on two norm-referenced teacher rating scales were examined to gain evidence about the validity of resulting IAA scores. To contextualize these findings, another group of 54…

State directors of teacher certification and testing provided updated data (reports, press clippings, manuals, legislative hearings, and validity studies) in April 1987 describing their testing programs and the latest passing rates. Twenty-seven states have admissions testing programs, and 44 have certification testing programs. It is unclear…

Means of interpreting norm-referenced tests to lead to more accurate reporting results are discussed, with particular emphasis on state-level and district-level data. Suggestions fall into the categories of documentation, frequency norming, and multiple form use. (TJH)

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)