This paper presents a specific bottom-up implementation method for getting started with multimedia for instructional support at the personal level. Some minimal top-down design considerations for an institutional multimedia system include: (1) the instructor should be able to take work from/to the desktop to/from the classroom; (2) the capability…

New methods are needed to judge the quality of alternative student assessment, methods which complement the philosophy underlying authentic assessments. This paper examines assumptions underlying validity, reliability, and objectivity, and why they are not matched to authentic assessment, concentrating on the constructivist paradigm of E. Guba and…

Many public libraries in the United States have undertaken the planning process suggested by the Public Library Association. They have incorporated into their mission statements some of the Association's eight basic library service roles as local priorities. This study explored the relationship between the chosen service role of 12 public library…

The aim of this study was to explore a method of improving the objectivity, reliability, and efficiency of scoring performance assessments that involve constructed written responses. Millman (1997) has suggested an alternative to using model responses at each score category. The proposed strategy, hypothesized to increase scorer reliability and…

An important feature of recent large-scale performance assessments has been the reporting of pupil and school performance in terms of performance or proficiency categories. When an assessment uses such ordered categories as the primary means of reporting results, the natural way of reporting on the quality of the assessment is through the…

This document contains three papers from a symposium on leadership and executive development. "Leading and Managing in a Service Organization: An Examination of Line vs. Staff Effectiveness" (Allan H. Church, Janine Waclawski) presents an analysis of differences in managerial strengths and weaknesses between 45 line managers and 52 human resources…

A study compared the nature and frequency of faults and errors in reference list entries and direct quotes selected from 78 articles in 8 issues of the "American Educational Research Journal" (AERJ) with authors sampled from 10 previously studied journals. All departures from the original (additions, omissions, or changes) were labeled as either a…

Given the complexity of classroom reading observations, maintenance of measurement reliability is a concern to researchers. Sources of variation contributing to the unreliability of many measurements may be either (1) lasting and specific, (2) lasting and general, (3) temporary and specific, or (4) temporary and general. Lasting-specific sources…

Procedures used in Doctor of Education (Ed.D.) dissertations at the University of Alabama (Tuscaloosa) were studied. Focus was on identifying: (1) characteristics of the research designs used; (2) sources of the instruments used to collect data; (3) reports of reliability estimates and evidence of validity of the instruments; and (4) types of…

The Walsh and Carballo evaluation of the effectiveness of transitional bilingual education programs in five Massachusetts communities, has the following flaws: (1) the sample of school districts studied suffered from "self-selection bias"; (2) the sample does not include a single large, urban school district; (3) the student samples…

A model and instrument based on leadership as social control theory (LASC) to assess leadership qualities of high school principals was developed in this study. The LASC model, based on symbolic interactionist and functionalist paradigms, attempts to explain the process by which leaders reduce conflicts between individual and organizational…

Psychometric theory has been one of psychology's stronger foundations and a major contributor to the recognition of psychology as a scientific discipline. Basic principles of psychometric theory led to the development of respected intelligence tests and large and comprehensive testing and assessment programs. This paper synthesizes major…

This document contains testimonies and prepared statements from the Congressional hearing called to examine the difficulties associated with the lack of reliable demographic data for use in planning appropriate assistance to "special populations" of older Americans, including minorities, persons with disabilities, the rural elderly,…

This paper examines the accuracy of student-reported demographic characteristics, activities, and accomplishments provided through the American College Testing (ACT) Assessment Program. The accuracy of five background characteristics, nine extracurricular activities, and 15 special accomplishments reported by students completing the ACT Assessment…

The use of meta-analysis in industrial and organizational psychology has become quite common. Unfortunately, the understanding and research necessary to ensure appropriate application of the technique have not been as widespread. As part of a larger study, a content analysis of meta-analyses from the industrial and organizational psychological…