A review of the recent literature has yielded a number of concerns about the validity, reliability, cost, efficiency, generalizability, utility, and cultural sensitivity of performance based assessments. The resulting conclusion was that continuing the performance based assessment initiative should be rethought. Suggested alternatives included…

The results of an evaluation of Vermont's statewide assessment initiative are presented, with information about the implementation of the program, its effects on educational practice, the analytic challenge presented by the portfolio scoring process, the reliability and validity of portfolio scores, and the tensions between assessment and…

An experimental study compared the effectiveness of a traditional General Educational Development (GED) curriculum with a literacy curriculum based on applied literacy skills. An experimental group of 34 adult students received GED instruction emphasizing functional and workplace contexts and supplemental instruction, whereas the 35 students in…

Standards-based assessment, or at least the concept of standards-based assessment, will provide a key strategy for the implementation of the New Zealand National Qualifications Framework. This paper considers the meaning of standards-based assessment and its role in New Zealand's assessment for nationally recognized qualifications. Standards-based…

Testing and assessment that are "more authentic" (performance-based or alternative) represent the most pressing issue in education today. Some of the major criticisms leveled at standardized testing are examined, and the advantages and disadvantages of more authentic assessment are reviewed. A general direction for integrating traditional and…

In problem-based learning, an instrument is needed to measure students' actual learning activities. Mapping the domain of learning activities undertaken by students and improving problems is especially important in a problem-based curriculum because students choose their own learning objectives. Such an instrument, the Topic Evaluation…

A study, conducted in a basic educational psychology course which serves as a gateway course to a teacher education program at Michigan State University, focused on the development of new knowledge while it taught about the educational research process and the subject being studied. A new format for objective testing, alternate-choice questions,…

In the second year of a project investigating the ability of secondary school teachers to identify high-ability students, two questions were addressed: what student characteristics influenced teachers' judgments, and why checklists appeared to have little impact on teachers' judgments. A structured approach was developed to study student…

The report presents a summary of selected quantitative measures for August 1987 through July 1988 of students who applied for University of Florida graduate school admission, those who were accepted by academic departments, and those who subsequently enrolled. A brief introduction and listing of procedural assumptions precede the two figures and…

The design and evaluation of a rating scale for program evaluation in problem-based medical curricula are described. The design process was guided by a theory of how students learn in problem-based learning as modeled by W. H. Gijselaers and H. G. Schmidt (1988). The rating scale was used in an evaluation of a new problem-based, community-oriented…

Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…

The keylist format (rather than the conventional multiple-choice format) for item presentation provides a machine-scorable surrogate for a truly free-response test. In this format, the examinee is required to think of an answer, look it up in a long ordered list, and enter its number on an answer sheet. The introduction of keylist items into…

This study investigated a number of questions regarding the nature of social concept development in young children. Subjects were 64 kindergarten children and 65 first grade public school students from lower to upper middle class socioeconomic levels, of whom 66 were male, 63 were female, 78 were Caucasian, and 51 were black. Two assessment…

The Performance Review, Analysis, and Improvement System for Educators (PRAISE) is a formative evaluation instrument designed to improve the performance of school principals. The system appears to be reliable and valid and is flexible enough to accommodate the needs of a variety of schools. Sample items and categories of the instrument include…

This paper focuses on the questions which arise as test practitioners monitor score scales derived from latent trait theory. Large scale assessment programs are dynamic and constantly challenge the assumptions and limits of latent trait models. Even though testing programs evolve, test scores must remain reliable indicators of progress.…