This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…

As a beginning step in research on the number, kinds, and characteristics of craftspersons ("crafts-artists") in the United States, a study was made of crafts organizations and their memberships. The survey was conducted to gather information that would permit designing a cost-effective and representative sample survey of individual crafts-artists…

Using the DACUM (Developing a Curriculum) process, the British Columbia Ministry of Education performed a task analysis of the work of recreation workers. A survey questionnaire was developed and mailed to 600 practitioners in the field; 262 were returned, with 232 of these usable. The majority of the respondents were from the Vancouver area, were…

A meta-analysis procedure was used to review research on pictorial effectiveness which focused on the use of static iconic visuals in instructional materials. The purpose of this exploratory study was to provide a means for forming future hypotheses based upon a quantitative aggregation of past research. The study was concerned with differential…

A set of interactive, computer-simulated experiments was designed to respond to the large range of individual differences in aptitude and reasoning ability generally exhibited by students enrolled in first-semester general chemistry. These experiments give students direct experience in the type of decision making needed in an experimental setting.…

The 16 papers in this collection discuss options and areas for future research on teams, including performance requirements, structure, communications, training techniques, and organizational determination of team performance, from the perspectives of varied disciplines; e.g., psychology, computer science, management science, and decision theory.…

Eight established methodologies were evaluated and compared in this preliminary study, which was conducted to resolve methodological questions and problems and develop an adequate approach for the collection of valid, generalizable data for an extensive study of family use of television. The study focused on four variables: which family members…

Findings and methodological problems of a survey on financial support for humanities in higher education are discussed. Usable data were gathered from 351 of 671 Higher Education Panel member institutions. Two weighting methodologies were employed. The conventional method assumed that nonrespondents were similar to respondents, whereas a…

The purpose of this paper is to: (1) explore some possible explanations for the lack of empirical support of advance organizers; (2) suggest a plan for improving the empirical research on advance organizers; and (3) recommend some further investigations needed in the area of advance organizers. Some explanations for this lack of support are…

The results of six major projects are discussed including a comprehensive mathematical and statistical analysis of the problems caused by errors of measurement in linear models for assessing change. In a general matrix representation of the problem, several new analytic results are proved concerning the parameters which affect bias in…

A project was conducted in Georgia to design a needs assessment instrument and to administer it in order to determine the current state of vocational education in the state. Following the collection and review of data and personal interviews with Georgia secondary and postsecondary teachers and administrators, a needs assessment survey form was…

The stability of sociometric measures and their use for classifying elementary-age children are discussed. This is an important topic because of the assumption that childhood social maladjustment is a very stable and consistent phenomenon. Sociometric scores were collected over a 7-month period in a study of potential developmental differences…

As part of the evaluation of the College of Education at the University of Tennessee, an annual survey is conducted to obtain principals' ratings of graduates who are certified beginning teachers. This survey has enjoyed a response rate in excess of 90 percent. The survey is conducted by mail, with one mail followup, and occasional telephone…

As yet there is no comprehensive, systematic, demonstrably effective program for maximizing empathetic communication behaviors. What is needed are theories, concepts, and methods that would provide for such learning. One avenue of approach is to search for models and metaphors that would allow for an encompassing comprehension of empathy and…

A set of interactive computer exercises developed for undergraduate students in experimental psychology and statistics courses is described. Each exercise is part of a self-contained module composed of an on-line experiment, full supporting documentation introducing the student to a substantive area of psychology, data analysis, a quiz with…