The research described in this paper shows the use of lexical semantic techniques for automated scoring of short-answer and essay responses from performance-based test items. Researchers used lexical semantic techniques in order to identify the meaningful content of free-text responses for small data sets. One data set involved 172 training…

Discusses performance-based standards for programs in Educational Communications and Instructional Technology (ECIT) as mandated by NCATE (National Council for Accreditation of Teacher Education) and the AECT (Association for Educational Communications and Technology) Accreditation Committee. Offers suggestions for adequate and appropriate…

Examines extent to which all 50 states implemented performance assessment in making professional licensure decisions as of 2001-02; considers differences among various types of assessments and different uses thereof. Describes three challenges to low state implementation of performance-based licensure: costs; need to ensure validity, reliability,…

To determine the factors that contribute to or compromise the effectiveness of multiscored items, this study combined analysis of statewide score data from the 1996 Maryland School Performance Assessment Program tests with systematic analyses of 60 activities providing measures of writing, language usage, or both, and one or more content areas.…

Reviews a number of promising methods for setting performance standards and discusses their strengths and weaknesses. Outlines some areas for future research that address the role of feedback to panelists and validation efforts for performance standards among other topics. (SLD)

A new method for evaluating rater accuracy within the context of performance assessments is described. It uses an extended Rasch measurement model, FACETS, which is illustrated with 373 benchmark papers from the Georgia High School Graduation Writing Test rated by 20 operational raters and an expert panel. (SLD)

Outlines essential features of program theory evaluation and discusses how it has been used to address concerns about inadequacies of performance information systems. Suggests enhancing the usefulness of program evaluation theory by incorporating information about program contexts, defining success criteria and comparisons for judging and…

Provides a brief historical review of construct validity and discusses the current state of validity theory, emphasizing the role of arguments in validation. Examines the application of an argument-based approach with regard to the distinction between performance-based and theory-based interpretations and the role of consequences in validation.…

Suggests that performance measurement can address attribution questions in studying accountability for results and outcomes in studies of public administration. Describes the steps necessary to produce a credible "contribution story" so that managers, researchers, and policy makers can arrive at conclusions about the contribution a…

Classroom teachers are among the few remaining employee groups whose evaluations and remuneration are generally unrelated to their performance. However, it is difficult to appraise a teacher's effectiveness by achievement of pupils because learning is not under an instructor's complete influence. New measurement techniques are emerging, however,…

The challenge of introductory finance courses often surprises junior level university students. This paper describes a strategy that effectively motivates students to prepare solutions to problems for each class and to be prepared to check work presented by classmates. Empirically, the participation grade was found to be positively and…

Using assessment results for 5th and 8th grade English language learner students in New Hampshire, Rhode Island, and Vermont, the report finds that the English language domains of reading and writing (as measured by a proficiency assessment) are significant predictors of performance on reading, writing, and mathematics assessments and that the…

One literature documents a significant, black-white gap in average test scores, while another finds a substantial narrowing of the gap during the 1980's, and stagnation in convergence after. We use two data sources--the Long Term Trends NAEP and AFQT scores for the universe of applicants to the U.S. military between 1976 and 1991--to show: (1) the…

It is well established that teacher quality is one of the most significant school influences on student achievement. Unfortunately, it is less clear how teacher preparation programs can prepare and recruit effective educators for every classroom. As the global economy demands that all students are college and career ready after high school,…

This article describes how two instructors used assessment data to improve an undergraduate course, Teaching Social Studies in the Elementary Classroom. This entailed revising the core assignment for the course--the creation of a thematic unit of instruction--and developing a scoring guide to assess teacher candidates' performance. Data collected…