In this discussion paper we seek to challenge prevailing wisdoms in higher education regarding the value of measuring teaching quality, prescribing standards for professionalism and using student satisfaction as an indicator of teaching effectiveness. Drawing on the literature, we explore and probe four wisdoms in an attempt to identify and…

Research in the UK has shown that students start their university career with the goal of mastering their subject, but this focus shifts as they progress through their degree program. Studies have suggested that unlike students in the UK, Russian students continue to take a strong mastery approach to their work. The main aim of this study was to…

The first part of this two-part paper [see EJ787497] described the development of a new freshman business mathematics (FBM) course at our college. In this paper, we discuss our assessment tool, the business memo, as a venue for students to apply mathematical skills, via mathematical modelling, to realistic business problems. These memos have…

The present study documents the results of a 17-month program to train Cardinal Health Pharmaceutical Technology Services (PTS) employees in an innovative model that combines investigative and writing techniques. Designed to address the Code of Federal Regulations (CFR) for the United States Food and Drug Administration (FDA), the program is a…

The importance-performance analysis (IPA) is a tool that can provide timely and usable feedback to improve training. IPA measures the gaps between the importance and how good (performance) a class is perceived by a student and is presented on a 2x2 matrix. The quadrant in which data land in this matrix aids in determining potential future action.…

The world in which learning and assessment must take place is rapidly changing. The digital revolution has created a vast space of interconnected information, communication, and interaction. Functioning effectively in this environment requires so-called 21st century skills such as technological fluency, complex problem solving, and the ability to…

The research described in this paper shows the use of lexical semantic techniques for automated scoring of short-answer and essay responses from performance-based test items. Researchers used lexical semantic techniques in order to identify the meaningful content of free-text responses for small data sets. One data set involved 172 training…

Discusses performance-based standards for programs in Educational Communications and Instructional Technology (ECIT) as mandated by NCATE (National Council for Accreditation of Teacher Education) and the AECT (Association for Educational Communications and Technology) Accreditation Committee. Offers suggestions for adequate and appropriate…

Examines extent to which all 50 states implemented performance assessment in making professional licensure decisions as of 2001-02; considers differences among various types of assessments and different uses thereof. Describes three challenges to low state implementation of performance-based licensure: costs; need to ensure validity, reliability,…

To determine the factors that contribute to or compromise the effectiveness of multiscored items, this study combined analysis of statewide score data from the 1996 Maryland School Performance Assessment Program tests with systematic analyses of 60 activities providing measures of writing, language usage, or both, and one or more content areas.…

Reviews a number of promising methods for setting performance standards and discusses their strengths and weaknesses. Outlines some areas for future research that address the role of feedback to panelists and validation efforts for performance standards among other topics. (SLD)

A new method for evaluating rater accuracy within the context of performance assessments is described. It uses an extended Rasch measurement model, FACETS, which is illustrated with 373 benchmark papers from the Georgia High School Graduation Writing Test rated by 20 operational raters and an expert panel. (SLD)

Outlines essential features of program theory evaluation and discusses how it has been used to address concerns about inadequacies of performance information systems. Suggests enhancing the usefulness of program evaluation theory by incorporating information about program contexts, defining success criteria and comparisons for judging and…

Provides a brief historical review of construct validity and discusses the current state of validity theory, emphasizing the role of arguments in validation. Examines the application of an argument-based approach with regard to the distinction between performance-based and theory-based interpretations and the role of consequences in validation.…

Suggests that performance measurement can address attribution questions in studying accountability for results and outcomes in studies of public administration. Describes the steps necessary to produce a credible "contribution story" so that managers, researchers, and policy makers can arrive at conclusions about the contribution a…