This paper presents a specific bottom-up implementation method for getting started with multimedia for instructional support at the personal level. Some minimal top-down design considerations for an institutional multimedia system include: (1) the instructor should be able to take work from/to the desktop to/from the classroom; (2) the capability…

Three methods for the estimation of the reliability of single dichotomous items are discussed. All methods are based on the assumptions of nondecreasing and nonintersecting item response functions and the Mokken model of double monotonicity. Based on analytical and Monte Carlo studies, it is concluded that one method is superior to the other two…

New methods are needed to judge the quality of alternative student assessment, methods which complement the philosophy underlying authentic assessments. This paper examines assumptions underlying validity, reliability, and objectivity, and why they are not matched to authentic assessment, concentrating on the constructivist paradigm of E. Guba and…

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…

This paper discusses research conducted in the spring of 1991 that measured the relationship of reading subtest scores to teacher ratings of students' reading abilities. Sixty-eight advanced-level students in an intensive English program took an institutional version of the Test of English as a Foreign Language (TOEFL) and a specimen reading…

Many public libraries in the United States have undertaken the planning process suggested by the Public Library Association. They have incorporated into their mission statements some of the Association's eight basic library service roles as local priorities. This study explored the relationship between the chosen service role of 12 public library…

This study illustrates the use of three least-squares models to control for rater effects in performance evaluation: (1) ordinary least squares (OLS); (2) weighted least squares (WLS); and (3) OLS subsequent to applying a logistic transformation to observed ratings (LOG-OLS). The three models were applied to ratings obtained from four…

Use of the School Climate and Context Inventory (SCCI) as a measure of school climate was investigated. The SCCI had previously been used as a measure of climate in a study of six rural high schools in Kentucky and Tennessee; in the current study, the SCCI was administered to 20 faculty members from each school. Split-half correlation and…

Several techniques for conducting studies of measurement integrity are explained and illustrated using a heuristic data set from a study of teachers' participation in decision making (D. L. Taylor, 1991). The sample consisted of 637 teachers. It is emphasized that validity and reliability are characteristics of data, and do not inure to tests as…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

The aim of this study was to explore a method of improving the objectivity, reliability, and efficiency of scoring performance assessments that involve constructed written responses. Millman (1997) has suggested an alternative to using model responses at each score category. The proposed strategy, hypothesized to increase scorer reliability and…

An important feature of recent large-scale performance assessments has been the reporting of pupil and school performance in terms of performance or proficiency categories. When an assessment uses such ordered categories as the primary means of reporting results, the natural way of reporting on the quality of the assessment is through the…

This study investigated the influence of role expectations, as defined by tenure status, on medical school faculty attitudes toward professional development activities. A total of 226 full-time faculty within a medical school completed a 15-item professional development goals questionnaire. The study found that full-time faculty perceptions of…

This document contains three papers from a symposium on leadership and executive development. "Leading and Managing in a Service Organization: An Examination of Line vs. Staff Effectiveness" (Allan H. Church, Janine Waclawski) presents an analysis of differences in managerial strengths and weaknesses between 45 line managers and 52 human resources…

Every year approximately 1,300 first-year students at the Rochester Institute of Technology complete a 50-minute placement essay during summer and fall orientations. The essays are scored holistically, and the students are placed into one of three levels of an English composition course. At the end of the 10-week quarter of instruction, students…