The presence of multiple readings of a student response to a constructed-response item in a large-scale assessment requires a procedure for combining the ratings to obtain an item score. An alternative to the averaged item ratings that are usually used is the summing of ratings for each item. This study evaluated the effect of summing as opposed…

This digest describes some basics of the construction of multiple-choice tests. As a rule, the test maker should strive for test item stems (introductory questions or incomplete statements at the beginning of each item that are followed by the options) that are clear and parsimonious, answers that are unequivocal and chosen by the students who do…

There is a considerable interest at Educational Testing Service (ETS) to include performance-based, natural language constructed-response items on standardized tests. Such items can be developed, but the projected time and costs required to have these items scored by human graders would be prohibitive. In order for ETS to include these types of…

Test developers continue to struggle with the technical and logistical problems inherent in assessing achievement across different languages. Many testing programs offer separate language versions of a test to evaluate the achievement of examinees in different language groups. However, comparison of individuals who took different language versions…

A study focused on three graduate students (within a class of six) as they encountered the portfolio process for the first time as learners. Each was asked to complete a learning portfolio as a self-evaluation component for a 14-week graduate reading course. The students determined their goals based on self-assessment, documented their progress…

This paper reports on a newly designed judgmental method for setting test performance standard that: (1) overcome many of the practical and psychometric problems associated with the Angoff and Ebel methods; (2) can be used to set multiple cut points on a score scale; (3) may be readily and efficiently implemented with assessments that use…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

The Quest program offers a comprehensive test and questionnaire analysis environment by providing a data analyst (a computer program) with access to the most recent developments in Rasch measurement theory, as well as a range of traditional analysis procedures. This manual helps the user use Quest to construct and validate variables based on…

Five teams of teacher-researchers, 15 teachers in all, representing three Wyoming school districts and Casper College conducted classroom-based investigations and wrote about their inquiries. These teachers of prekindergarten through college collaborated to examine performance based assessment questions with an overall theme of improving science…

The feasibility of the administration, scoring, and reporting of an on-line concept mapping system has been studied in collective research in which concept map construction systems were designed to allow students individually and collaboratively to construct concept maps on the computer to measure content understanding and collaboration. The study…

This handbook provides teachers and administrators with strategies to construct, adapt, and use rubrics. A rubric is defined as a tool for assessing instruction and performance according to predetermined expectations and criteria. The chapters in this text contain guidance on formulating, applying, and reviewing the pros and cons of this form of…

The handbook addresses the assessment of student performance and the establishment of criteria by which to measure student progress in six domains within science: (1) Concepts; (2) Processes; (3) Applications; (4) Attitude; (5) Nature of Science; and (6) Creativity. Each domain is defined, and a rationale is provided for assessing student learning…

The Texas Education Agency has been developing materials to address issues related to the Professional Development Appraisal System (PDAS). The PDAS was developed under a legislative mandate to establish a fair and practical appraisal process that acknowledges and reinforces good teaching practices and quality professional development. An…

The Windsor Central School District Leadership Team in rural upstate New York, as charged by the State Education Commissioner, addressed issues of improving student outcomes by defining exit goals and outcomes for high school students to accomplish by the time they graduate. In addition to developing these goals and outcomes, the team also decided…

Tests are intended to assess performance of students. However, tests can also be used as an educational tool. Current patterns in education have produced a group of students with weak learning skills, limited confidence in their own abilities, an underlying hostility or distrust of the educational system, and an inhibited attitude towards…