In adolescence research, the treatment of measurement reliability is often fragmented, and it is not always clear how different reliability coefficients are related. We show that generalizability theory (G-theory) is a comprehensive framework of measurement reliability, encompassing all other reliability methods (e.g., Pearson "r,"…

On the basis of the characteristics of criterion-referenced tests, the contribution of German research to the development and application of criterion-referenced tests is discussed. (PN)

The literature on criterion referenced testing is full of discussions concerning whether classical measurement techniques are appropriate, whether variance is necessary, whether new indices of reliability are needed, and the like. What appears to be lacking, however, is a clear and simple discussion of why the problems occur. This paper suggests…

Explains and contrasts the techniques and philosophies of norm-referenced (NRT) and criterion-referenced tests (CRT). NRTs are criticized for lack of useful information and control. CRTs are usually teacher-made and customized to fit the classroom needs, offering more control over test content, but few teachers are prepared to develop them. (SM)

Discusses the use of standardized test results as a guide to developing curriculum content and uses data gathered at Hellgate Elementary School, Montana, as an example. (JC)

Discusses the use of standardized test results as a guide to developing curriculum content. Discusses such a plan being used (and offers data gathered) at Hellgate Elementary School, Montana, as an example. (JC)

This monograph is designed for educators who must make decisions about curriculum, instruction, and the training of teachers. Many important educational decisions are made based primarily, if not exclusively, on test scores. This reliance on test scores has evolved for a variety of reasons. This monograph starts with test scores as a given in…

Because testing, in many different forms, currently plays such an important role in education, Elementary Secondary Education Act, Title I, the Division of Federal Assistance in the Vermont State Department of Education, prepared this brochure to present a general introduction to terms and phrases commonly used in testing and to highlight some of…

The potential of a cognitive model task analysis scheme (CMS) that specifies features of test problems shown by research to affect performance is explored. CMS describes the general skill area and the generic task or problem type. It elaborates features of the problem situation and required responses found by research to influence performance.…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

Presents major stages in design and development of criterion referenced tests (CRT) with emphasis on differences between CRT construction and norm-referenced test construction. Discussion covers test interpretation; test theory; preparation for test construction (hierarchical analysis, item type selection, and choosing number of items); test…

Proposes that objective-referenced tests replace norm-referenced tests as a vehicle for program evaluation. Describes a methodology, based on latent trait theory, for joining norm-referenced and objective-referenced testing in a customized testing program. (TE)

Standardized achievement tests are often misused as indicators of a school's quality or effectiveness relative to other schools. This is an incorrect use because it ignores variation among schools in student abilities, family support of education, student mobility, and other factors. People also misuse tests because they impute to them more…

Increasing numbers of state-mandated testing programs have resulted in the selection of norm-referenced tests (NRTs) for statewide assessment. Adaptation or customization of existing tests has become a viable solution for individual programs. Changes in test instruments have arisen from the behaviorist approach and mastery learning, minimum…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…