In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…

The evaluation of gifted programs is examined in terms of setting group and individual goals, measurement problems (validity, reliability, precision, ceiling effect, and overtesting), comparison groups (national norms or pre- and posttesting), and implementing evaluation strategies. (DB)

The effects of monetary gratuities on response rates to mail surveys have been considered in a number of studies. This meta-analysis examined: (1) the nature of the population surveyed; (2) the effects of gratuities in relation to the number of follow-ups; (3) whether the gratuity was equally effective across different populations; (4) whether the…

In an attempt to improve Head Start evaluations, several methodological techniques are proposed. Since programs vary in approach, evaluations must be made on the success of the individual programs. Formulation of research questions should provide information as to the process and outcome of the program. To avoid experimenter bias, experimenters…

This article is intended to give a critical evaluation of the "learning test methodology," with special regard to diagnosis and optimization of learning processes. The learning test concept is based on the "pretest--educational training intervention--posttest" approach. (PN)

An original study with a 96 percent questionnaire return rate and four replications with high return rates were compared in terms of populations sampled, implementation, and results. Future use of this procedure, which includes advance mailing, telephone contact, telephone explanations, and followups, is discussed. (SLD)

Reviews studies focusing on practical assessment in science. Areas considered include what students are really doing in laboratories, how practical skills should be assessed, methods used to assess practical science (such as internal/external examinations and continuous assessment), methodological issues, and reasons for the failure of some…

In discussing the problems of evaluating Canadian bilingual immersion programs, six related aspects are separately considered: (1) the research design, (2) the students tested, (3) the nature of the tests used, (4) the methods of analysis employed, and (5) the interpretation of findings. (Author/SJL)

This collection is based on the fact that employment, housing, and consumer rights and opportunities are often inextricably linked and mutually dependent. The papers explore aspects of creating a national report card on discrimination, assessing the role that testing and other social science methodologies might play in its formulation. The papers…

AN INTRODUCTION WHICH STATES THE PURPOSES OF AN EVALUATION OF FLES PROGRAMS AND STRESSES THE DIFFERENCE BETWEEN VALUE JUDGMENT AND EVALUATION IS FOLLOWED BY A DISCUSSION OF THE RELATION BETWEEN EVALUATION AND CURRICULUM. TEST AND MEASUREMENT PROCEDURES FOR EVALUATING FLES PROGRAMS ARE THEN SUGGESTED. A CONCLUDING SECTION INDICATES THE DESIGN OF A…

The various costs of Type I and Type II errors of inference from data are discussed. Six methods for minimizing each error type are presented, which may be employed even after data collection for Type I and which minimizes Type II errors by a study design and analytical means combination. (Author/CM)

Discusses the need for awareness of real and potential problems in educational evaluation approaches, kinds of problems there are with true experimental designs and with quasi-experimental designs, and the criteria applied by the Joint Dissemination Review Panel to its review of educational programs. (MF)

With the increasing globalization of human resources practices, a commensurate increase in demand has occurred for multi-language ("global") personality norms for use in selection and development efforts. The combination of data from multiple translations of a personality assessment into a single norm engenders error from multiple sources. This…

A discussion of selected applications of new tests developed within the context of a large-scale curriculum for educable mentally retarded (EMR) children, the Social Learning Curriculum (SLC), is presented in this paper which investigates three types of reliability that need to be demonstrated in order to provide a basis of these applications. The…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…