Basic issues in criterion-referenced measurement are addressed. In section II, issues involved in determining what a person does and can do are considered. A preliminary analysis of "can" is given which shows that there are several important senses of "can". In section III, results of an analysis of "ability" are…

A behavioral domain is well-defined when it is clear to both test developers and test users which categories of performance should or should not be considered for potential test items. Only those tests that are keyed to well-defined domains meet the definition of criterion-referenced tests. The greatest proliferation of criterion-referenced tests…

Two approaches to criterion-referenced test construction are compared. Classical test theory is based on the practice of random sampling from a well-defined domain of test items; latent trait theory suggests that the difficulty of the items should be matched to the achievement level of the student. In addition to these two methods of test…

Confusion in the terminology used in criterion-referenced measurement specifications and development and standard setting and the attendant role of cut-off scores are shown to need practical clarification through psychometric research on test applications and consequences. (CM)

Standardized achievement tests and instructional accomplishment inventories involve different methodologies and cannot be equated by using conventional psychometric methods. Instructional accomplishment inventories are descriptive, and are designed to reflect the scope, sequence, and skills and emphasis in a particular instructional program.…

A review of functional literacy testing in the United States from 1955-82 is provided by summarizing the results of literacy assessment studies and synthesizing the major issues which they have engendered. These reviews are grouped with respect to content, criterion-related, and construct validity. The paper concludes by (1) summarizing some of…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

Presents major stages in design and development of criterion referenced tests (CRT) with emphasis on differences between CRT construction and norm-referenced test construction. Discussion covers test interpretation; test theory; preparation for test construction (hierarchical analysis, item type selection, and choosing number of items); test…

Criterion-referenced testing was used to complement norm-referenced procedures in a revision of a university's English-as-a-Second-Language placement test for reading. Test validation results indicated that the revised test better matched the university's program and included more items related to the content and skills that students were…

An empirical review of test items is described as an essential step in criterion-referenced test development. The concept of test items' instructional sensitivity is introduced, and research is briefly reviewed which describes four theoretical contexts in which instructional sensitivity indexes have been observed: criterion-referenced; classical…

This report describes technical plans and progress during the second year (Fiscal Year 1984) of work on the U.S. Army's Project A: "Improving the Selection, Classification, and Utilization of Army Enlisted Personnel." Project A is a long-range research program developed by the Army Research Institute for the Behavioral and Social…

The feasibility of criterion referenced testing is held to be dependent on the tenability of two postulates: (1) that bias can be controlled in a principled manner from one test to the next; and (2) that one mental process measured by such tests may lawfully interact with another. Without the first postulate, criterion scores could not be…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…

This handbook was designed to help Australian technical, adult, and further education (TAFE) teachers, especially those in vocational education areas, to assess and evaluate students. The guide contains seven chapters, each written so it can stand alone. At the beginning of each chapter is an explanation of what is to follow and a statement of the…

Three approaches to the construction of achievement tests are compared: construct, operational, and empirical. The construct approach is based upon classical test theory and measures an abstract representation of the instructional objectives. The operational approach specifies instructional intent through instructional objectives, facet design,…