This manual is designed to help bibliographers, librarians, and other materials selectors plan and conduct systematic collection evaluations using both collection centered and client centered techniques. Topics covered in five chapters are: (1) planning the assessment; (2) collection-centered techniques, comprising the compilation of statistics,…

This handbook describes the procedures used to administer and analyze the results of the 1978-79 national music assessment of the National Assessment of Educational Progress (NAEP). It also describes changes in procedures between the first NAEP music assessment conducted in 1971-72 and the 1978-79 assessment. Each assessment surveyed the music…

This document reports the pilot test of the two components of the Child and Family Mental Health (CFMH) Evaluation Project -- the impact evaluation component and the in-depth evaluation component. (The impact evaluation is designed to determine the effects of the two primary prevention models of service and activities on the CFMH Head Start…

The primary sample for Year 11 of the National Assessment of Educational Progress (NAEP) was selected in March 1979, and was preceded by an 18-month planning effort. During the planning period, research concentrated in five specific areas: sampling frame construction, stratification criteria, efficiency study review, techniques and computer…

In order to assess the methodological merit of the published research in educational administration based on surveys, the authors analyzed data from a random sample of 24 survey studies published in the "Education Administration Quarterly" and the "Journal of Educational Administration." Each article was evaluated according to…

Intended as a supplement to the National Testing Service (NTS) project proposal of September 12, 1978, this report describes the status (as of November 15, 1978) of the evaluation design and the field implementation plan used for the national evaluation study of Head Start Educational Services and the Basic Educational Skills demonstration…

Research on the Rasch model of test and item analysis was applied to tests constructed from item banks for reading and mathematics with respect to five practical problems for scaling items and equating test forms. The questions were: (1) Does the Rasch model yield the same scale value regardless of the student sample? (2) How many students are…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

A fictitious community of 583 households was set up to simulate a survey population, and was used in two laboratory assignments where students "interviewed" householders by a quota sampling procedure and tested the performance of several probability sampling designs. (Author/JEG)

A new approach to item analysis, concerned not only with differences among individuals, but also differences among the groups in which the individuals may have membership, is described. This multi-level aspect may be applied to studies of differences among individuals, classes, and schools, depending upon the kind of problem being studied and the…

Methods and results relevant to the introduction of item characteristic curve (ICC) models into classroom achievement testing are provided. The overall objective was to compare several common ICC models for item calibration and test equating in a classroom examination system. Parameters for the one-, two- and three-parameter logistic ICC models…

The setting of standards involves subjective value judgments. The inherent arbitrariness of specific standards has been severely criticized by Glass. His antagonists agree that standard setting is a judgmental task but they have pointed out that arbitrariness in the positive sense of serious judgmental decisions is unavoidable. Further, small…

Statistical data are presented on interviews conducted through the Continuous National Survey (CNS) at the National Opinion Research Center in Chicago and based on results reprinted from "Public Concepts of the Values and Costs of Higher Education," by Angus Campbell and William C. Eckerman. The CNS results presented in this report are…

The purposes of this project were to identify, review, and analyze student and employer follow-up efforts and to synthesize findings into a review of and synthesis document (reported here) and a vocational follow-up training manual (CE 022 288). The central focus of the project was on methodology rather than findings. The review was restricted to…

Available library statistical information is unreliable and missing in many areas. This report covers three general subjects: (1) the description of the nature of the figures that are currently available, including lists of library statistics publications, and an indication of some information which is wanted but not available; (2) a discussion of…