Twenty-two handicapped and 10 nonhandicapped young children were administered the Evaluation and Programing System Level 1 (EPS-1), a measure designed to provide information to develop educational programs and assess program effectiveness. The article notes reliability, validity, and utility data. (Author/CL)

The reliability of criterion-referenced tests (CRTs) used in health program evaluation can be conceptualized in different ways. Formulas are presented for estimating appropriate standard error of measurement (SEM) for CRTs. The SEM can be used in computing confidence intervals for domain score estimates and for a cut-score. (Author/LMO)

The criterion issues in the area of outcome research in psychotherapy were addressed and reviewed. Through this review of previous outcome research, it was determined that three basic criterion areas related best to traditional outcome variables such as therapist and community informant ratings, length of stay, and rehospitalization. These three…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

The feasibility of using criterion referenced tests (CRTs) in a large-scale evaluation conducted in an effectiveness evaluation context was investigated. The study began by examining the theory that structures the development and validation of CRTs to discover whether, on theoretical grounds alone, CRTs are suitable or not suitable for large-scale…

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

The reliability of criterion referenced tests, which are often used to evaluate health education programs, may be conceptualized in different ways. Classical conceptualizations of test reliability have limited usefulness when applied to health-related criterion referenced tests. When a cutting score is set, test reliability can be represented as…

A set of pilot performance reference scales was developed based upon airborne Audio-Video Recording (AVR) of student performance in T-37 undergraduate Pilot Training. After selection of the training maneuvers to be studied, video tape recordings of the maneuvers were selected from video tape recordings already available from a previous research…

This paper highlights some special characteristics of criterion-referenced tests while comparing them with norm-referenced tests. Psychometric considerations involved in constructing a criterion-referenced test, including item analysis, reliability, and validity, are discussed, along with application of criterion-referenced testing to individual…

The objectives of this booklet are to provide suggestions, procedures, and rules of thumb to aid the evaluator in using achievement tests in program evaluation. It also discusses some of the theories underlying the procedures for developing and selecting achievement tests and interpreting their results. Each of the six chapters offers advice on…

The orientation of this report is that of identifying educational projects which can be considered truly exemplary. The bulk of the report consists of a 23-step procedure for validating the effectiveness of educational programs using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data…

Ten papers presented at the first annual meeting of the Georgia Educational Research Association describe the following topics in educational research: (1) development and evaluation of the Elementary Curriculum Development Program, which involves individualized instruction in grades K-8; (2) reliability of the eighth grade reading subscales on…

This chapter should not only acquaint the reader with the present state of the art on Criterion-Referenced (CR) measurement but also suggest possible directions for further inquiry. The goal of the first part of this chapter is to deal with the definitional dilemma of CR measurement by proceeding from the more traditional view of CR measurement to…