In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This paper discusses new psychometric analyses that improve capabilities for relating performance on achievement test items to instruction received by examinees. The modeling discussion is closely tied to data for eighth graders in the United States provided by the Second International Mathematics Study (SIMS), comprising not only responses to a…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

An advisory committee representing counselors, curriculum specialists, students, teachers, and community members should participate in selecting standardized tests for school districts. These steps should be followed: (1) identify test purpose in relation to needs and objectives--diagnosis, placement, career guidance, program evaluation; (2)…

Establishing and refining a framework for performance assessment is especially difficult in large-scale settings that can involve hundreds of judges and thousands of students. This presentation advocates the interactive use of two complementary analytic perspectives and illustrates the approach in the context of the College Entrance Examination…

The goal of this monograph is to explain the evaluation program designed by Schaumburg Community Consolidated District 54, Schaumberg, Illinois. It discusses the process used in the development of the model, the product, the implication for classroom teachers and the effects of using an evaluation to assess science process skills. The process…

As part of the career development curriculum materials for Michigan schools, this packet contains six sample student assessment test booklets. One of the test booklets provided is for grade 4; two are for grade 7; three are for grade 10. The booklets assess students' progress in meeting the state's essential performance objectives for career…