This paper addresses the educational, technical, legal, and practical challenges states must confront as they consider the content of the assessment, its technical quality, the capacity of educators and the public to use the results of the assessment, the benefits and additional complications of performance testing, and the overall tension betwen…

This study investigated the characteristics of Computer-based Case Simulations (CCS) that may be associated with case difficulty. Difficulty was defined as the average rating by physicians of examinee performance on a nine-point scale or the passing rate on the cases. Two data sets were used, one from an administration of 18 cases to 201 medical…

This paper reviews a year's work with third-grade teachers who introduced performance assessments in the hope of improving both instruction and assessment in mathematics. The 14 participating teachers in 3 schools tried many changes in their educational and assessment practices. Patterns of stability and change that resulted from their efforts…

To determine trends in reporting test reliability, 88 articles addressing 188 instruments in 1980, 81 articles covering 205 instruments in 1985, and 67 articles assessing 195 instruments in 1990 in the "Journal of Counseling Psychology" were reviewed. Articles were examined for the way in which reliability was discussed and reported, and…

Effective-schools researchers have identified factors that are correlated with improved school achievement. School districts and state departments of education have applied this research to school improvement frameworks. This paper describes how Effective Schools Research was employed to develop a questionnaire to assess school staff perceptions…

This collection of examples of authentic assessments has been compiled to provide a sampling of the many new strategies for evaluating student work and learning that are being developed and used in schools around the country. These strategies are called "authentic" because they require that students demonstrate what they can do as…

This paper reports on existing studies and uses meta analysis to compare and synthesize the results of 20 studies from 8 research reports comparing the ability measure equivalence of computer adaptive tests (CAT) and conventional paper and pencil tests. Using the research synthesis techniques developed by Hedges and Olkin (1985), it is possible to…

This report describes the development and pilot testing of a fire safety certification system for board and care operators and staff who serve clients with developmental disabilities. During Phase 1, training materials were developed, including a trainer's manual, a participant's coursebook a videotape, an audiotape, and a pre-/post test which was…

A method is presented for collecting information about the match between students' learning issues in problem-based learning and teachers' objectives. Subjects were 82 second-year medical students at the University of Limburg in Maastricht (Netherlands) in a problem-based curriculum. During a unit on pregnancy, childbirth, and child development,…

When an examination consists in whole or part of constructed response test items, it is common practice to allow the examinee to choose a subset of the constructed response questions from a larger pool. It is sometimes argued that, if choice were not allowed, the limitations on domain coverage forced by the small number of items might unfairly…

A job analysis was conducted, focusing on the knowledge and abilities important for beginning French teachers. The results of the job analysis are to be used to define the content domain of the subject assessment in French for the Praxis series of professional assessments for beginning teachers. A domain of 212 knowledge statements and ability…

Two studies investigated the comparability of scores from paper-and-pencil and computer-administered versions of the College-Level Examination Program (CLEP) General Examinations in mathematics and English composition. The first study used a prototype computer-administered version on each examination for 94 students for mathematics and 116 for…

The purpose of this research was to compare two different forms of a placement test in French as a second language at the post-secondary level, a conventional test and a computerized test. First, expectations regarding a placement test as a measure of general proficiency are discussed and principles of adaptive testing that have been used to…

Critical evaluation of instructional materials is an important but often neglected aspect of instructional preparation. This study proposes evaluation that is more theoretically grounded in sociocultural and context-sensitive bases than are many evaluation guides. A new instrument was developed and applied to materials for teacher education as…

The development of a process to assess higher order thinking skills associated with thinking in real world situations raises questions about the domain of assessment, the skills and dispositions to be assessed, and the purpose of the assessment. It is argued that existing critical thinking courses and instruments may be of limited value in…