Multidimensional scaling and cluster analysis were used to describe and categorize tasks from six graduate disciplines including academic psychology, applied psychology, English literature, journalism, physics, and electrical engineering. A sample of task descriptions was constructed through interviews with four or five graduate students from each…

The release of the newest Sixteen Personality Factor Questionnaire (16PF), Fifth Edition, is the evolution of Raymond Cattell's conceptualization of the primary components of personality by analyzing adjectives describing human behavior. This updated version continues to measure the same 16 primary personality factors with improved reliability and…

Evidence is presented for the validity and reliability of a student annotation form used to collect student reflections on work samples in portfolios. The form was designed to be general enough to apply to many grades and subjects and simple enough for students at all levels to complete. The annotation forms asked students to indicate how…

The varying impacts of three instructional environments for introductory chemistry on the inquiry skills of undergraduate students were studied. The first two environments were traditional (TR) and guided-inquiry (GI) laboratory-based instructional situations, and the third was a separate lecture course for nonscience majors that emphasized…

The FACETS equating model meets the complex requirements for equating writing performance assessment across both raters and prompts. This study is based on an equating of the 1996 writing performance assessment in the Minneapolis Public Schools (Minnesota). Raters and prompts were equated simultaneously using the FACETS model. About 3,000 fifth…

This report provides an overview of a selection of measurement error studies conducted on National Center for Education Statistics (NCES) surveys. Its intent is not to offer new analyses of program data, but to summarize information from internal memoranda, working papers, and adjudicated reports about errors of measurement that occur during five…

This paper presents a specific bottom-up implementation method for getting started with multimedia for instructional support at the personal level. Some minimal top-down design considerations for an institutional multimedia system include: (1) the instructor should be able to take work from/to the desktop to/from the classroom; (2) the capability…

Three methods for the estimation of the reliability of single dichotomous items are discussed. All methods are based on the assumptions of nondecreasing and nonintersecting item response functions and the Mokken model of double monotonicity. Based on analytical and Monte Carlo studies, it is concluded that one method is superior to the other two…

New methods are needed to judge the quality of alternative student assessment, methods which complement the philosophy underlying authentic assessments. This paper examines assumptions underlying validity, reliability, and objectivity, and why they are not matched to authentic assessment, concentrating on the constructivist paradigm of E. Guba and…

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…

This paper discusses research conducted in the spring of 1991 that measured the relationship of reading subtest scores to teacher ratings of students' reading abilities. Sixty-eight advanced-level students in an intensive English program took an institutional version of the Test of English as a Foreign Language (TOEFL) and a specimen reading…

Many public libraries in the United States have undertaken the planning process suggested by the Public Library Association. They have incorporated into their mission statements some of the Association's eight basic library service roles as local priorities. This study explored the relationship between the chosen service role of 12 public library…

This study illustrates the use of three least-squares models to control for rater effects in performance evaluation: (1) ordinary least squares (OLS); (2) weighted least squares (WLS); and (3) OLS subsequent to applying a logistic transformation to observed ratings (LOG-OLS). The three models were applied to ratings obtained from four…

Use of the School Climate and Context Inventory (SCCI) as a measure of school climate was investigated. The SCCI had previously been used as a measure of climate in a study of six rural high schools in Kentucky and Tennessee; in the current study, the SCCI was administered to 20 faculty members from each school. Split-half correlation and…

Several techniques for conducting studies of measurement integrity are explained and illustrated using a heuristic data set from a study of teachers' participation in decision making (D. L. Taylor, 1991). The sample consisted of 637 teachers. It is emphasized that validity and reliability are characteristics of data, and do not inure to tests as…