Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This article discusses the positive and negative consequences of large-scale testing on five key stakeholders of testing results: students, teachers, administrators, policymakers and parents. The factors that affect the nature of testing consequences are also discussed and means that may provide remedies for associated pitfalls are proposed.

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

Tests are used in four ways: (1) to select; (2) to give rewards or punishments; (3) as tools in the instructional process; and (4) as macro-evaluation of instructional programs and systems. The Program for Research on Objective Based Evaluation (PROBE) is directed at developing prototypic evaluation systems in the reading area for both classroom…

This bulletin describes two phases of an experiment in examining science, one in 1963, and the second in 1964. The first phase of the experiment explored two forms of assessment: a Scientific Thinking paper; and a Practical paper. In the second phase two further factors were introduced: a Facts and Principles paper; and an Assessment of course…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

The Alaska Statewide Assessment Test is administered to fourth and eighth graders every two years in reading and mathematics. Assessment Report 7 describes how the assessment process works, analyzing results, test content, results for 1983, and statewide average scores. A question-answer format is used to discuss the following: (1) Was students'…

Writing assessment began in Alaska in the 1970s, and the Alaska Writing Assessment (AWA) that was piloted in 1997 built on previous efforts. The 1997 AWA involved more than 20,000 students in grades 5, 7, and 10 from 43 school districts, and the mandatory assessment planned for 1998 will include approximately 28,000 students. This review of the…

As an evaluation report, this 1970 document summarizes information from 13 Arizona school districts involved in special English classes under House Bill No. 1. Program emphasis was on oral language development, vocabulary, and comprehension. Each district used its own method of evaluating progress; therefore, in synthesizing the information, each…

The purpose of this document is to provide teachers, administrators, students, and parents with samples of students' performances that exemplify standards in relation to the 1993 Grade 9 Science Performance-Based Assessment Tasks for the province of Alberta, Canada. A sample of 698 randomly selected students from 31 schools did the…

The Alaska Statewide Assessment Test (ASAT) in reading and math is administered to fourth and eighth graders every two years. This document contains three separate assessment reports generally titled "An Update on the Alaska Statewide Testing Program." Assessment Report 8, "The Interpretive Panels Look at Results," lists…

An amendment to the Job Training Partnership Act (JTPA) mandated an assessment of the basic skills of all Summer Youth Employment and Training (SYET) Program enrollees. Many agencies in California used the Employability Competency System Appraisal Test to assess 1987 SYET participants' basic reading and math skills. Between June and October 1987,…

The efficiency of three written papers dealing with essay writing, comprehension, and literature papers as a test of English ability was assessed in a trial examination administered to 182 boys and 216 girls, all of whom were 16 years of age. Criterion was established on the basis of teachers' assessments of six essays written by the students…

The speeches presented at the second national conference on testing deal with models for program evaluation, reporting of test results, minimum competency programs, and the role of state and federal government in educational testing. Various approaches to program evaluation, and its relationship to testing are described by Michael Scriven, Lee J.…

To assess attainment of basic skills, the San Diego Board of Education mandates that all students in regular programs at grades 5, 7, 9 and 11 be tested by the Districtwide Testing Program. This evaluation report presents the academic achievement of Grade 11 (Fall 1984) students in comparison with (1) a national norm group and (2) previous years…