The major goal of this study is to apply the essential unidimensionality statistic of W. Stout and the corresponding computer program (DIMTEST) to a hierarchical level mathematics achievement data set and to determine the extent to which the undimensional assumption can be accurately applied to mathematics achievement data. The study also…

The 1992-93 school year saw the second statewide implementation of the Vermont portfolio-assessment program, and RAND continued its ongoing evaluation of the program's implementation, effects, and data quality. While the first year's study found evidence of the impact of the assessment program and low reliability of portfolio scoring, this year's…

Performance rating systems frequently use multiple raters in order to improve the reliability of ratings. However, unless all candidates are rated by the same raters, some candidates will be at an unfair advantage or disadvantage solely because they were rated by more stringent or lenient raters. To obtain fair and accurate evaluations of…

The first of two sections of this paper describes a pilot program that used interactive video (IAV) technology to enhance the scripting skills of teacher certification assessors in the administration of a classroom observation technique. A comparative analysis was drawn between three groups of assessors: those who received IAV programed…

We assessed whether and how the discourse written for prototype integrated tasks (involving writing in response to print or audio source texts) field tested for the new TOEFL® differs from the discourse written for independent essays (i.e., the TOEFL essay). We selected 216 compositions written for 6 tasks by 36 examinees in a field…

The use of optical scanners and computers in educational testing is common where objective testing methods (such as true-false, matching, and multiple-choice items) are well-established means of evaluating educational achievement. Where non-objective testing methods (such as fill-in-the-blank, short-answer, and essay items) have been more common,…

During the Spring of 1989, the North Carolina Department of Public Instruction field-tested a geometry proof performance assessment as a component of the High School End-of-Course Testing Program (EoC). The existing geometry EoC test consisted only of multiple-choice items. The performance assessment was added to the multiple-choice component to…

The writing assessment used in grade 10 of the Cherry Creek, (Colorado) schools is described. Over the past 3 years, the focus of the assessment has changed from an assessment heavily weighted on multiple-choice items, with minimal constructed response tasks, to an assessment based entirely on a written product. Students are provided with multiple…

This paper presents data currently available on two new self-administered student-rating questionnaires that can facilitate the professional growth of teachers by giving them feedback about classroom interactions: (1) the Invitational Teaching Survey (ITS); and (2) the Student Attitudinal Outcome Measures (SAOM). The ITS, developed within the…

This manual is designed to provide Tennessee School administrators and supervisors with the information needed to understand the revised Career Ladder Evaluation System, and prepare them for the evaluation at Career Levels I and II. The manual covers the following information: (1) improvements of the revised system; (2) assumptions and principles;…

This document is an orientation manual for the Library Media Specialist Evaluation System, a part of the Tennessee Career Ladder Better Schools Program. This evaluation system was developed by using the best ideas from educational research and from library media specialists in Tennessee. The system was field tested in the fall of 1985. Contained…

The aims of the projects described in this paper were to develop and evaluate a new approach to the assessment of English language skills of English as a second language (ESL) students. The approach makes use of optical scanning equipment in scoring cloze-elide test exercises, thereby providing a rapid, relatively inexpensive and objective measure…

This handbook exists to assist the staff of a Springfield, Illinois school district in implementing the district assessment program and to assist other local school units in developing and assessing an implementation program. Chapter 1 presents information on the philosophical and pragmatic background of comprehensive assessment programs, with…

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…

The methods used by the General Educational Development Testing Service (GEDTS) to establish and maintain score stability and reading reliability on its direct assessment of writing are described. Using the 1988 site certification and monitoring results of several scoring sites, the focus is on describing how the score scale was established and…