In adolescence research, the treatment of measurement reliability is often fragmented, and it is not always clear how different reliability coefficients are related. We show that generalizability theory (G-theory) is a comprehensive framework of measurement reliability, encompassing all other reliability methods (e.g., Pearson "r,"…

Universal screening in elementary schools often includes administering curriculum-based measurement in reading (CBM-R); but in first grade, nonsense word fluency (NWF) and, to a lesser extent, word identification fluency (WIF) are used because of concerns that CBM-R is too difficult for emerging readers. This study used Kane's argument-based…

Validity coefficients, standard errors of estimate, and prediction are discussed. An argument is made for the potential utility of tests with validity coefficients of .60, .50, .40, and even .30, because they can predict the extremes, which is especially valuable for many purposes, such as counseling, college admissions, and personnel selection.…

Some basic statistical concepts relevant to the teacher--mean scores, standard deviation, normal and skewed distributions, z scores, item analysis, standard error of measurement, reliability--and their use by the teacher are explained. (RM)

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

While most school districts believe they understand grade equivalent scores, teachers, parents, and measurement specialists frequently misinterpret this apparently simple statistical expression. Echternacht's article describes the construction, application, and interpretation of grade equivalent scores from the test publisher's perspective.…

Development of new scales from test items usually requires several hundred cases in each of the defined groups. Application of multivariate techniques to existing test scales also encounters such problems as multicolinearity, combining ipsative with normative measures and ordinal with equal interval scales, differential prediction, and…

Scores of high school students responding to the same biology cognitive preference test using both normative and ipsative procedures were compared. All subtests, whether ipsative or normative, had high alpha Cronbach coefficients. A number of similarities were found in the mean scores obtained by the two procedures, as well as moderate positive…

An experiment was performed to evaluate the tenability of the assumption in the Elementary Secondary Education Act (ESEA) Title I proposed variance estimation procedures for criterion referenced tests. The assumption is that the ratio of the local to the national standard deviation for the national sample will be the same for the normed test as…

A diagnostic test in English as a second language should be a series of miniature tests on specific problems. Subscores in each area should be considered rather than a total score. The results should be used to probe mastery in an area rather than provide the means for comparing one student against another. The statistical reliability of the…

Using the basic principles of generalizability theory, a psychometric model for domain-referenced interpretations is proposed, discussed, and illustrated. This approach, assuming an analysis of variance or linear model, is applicable to numerous data collection designs, including the traditional persons-crossed-with-items design, which is treated…

It is unsafe to estimate achievement test norms for fall testing by linear interpolation between norms for the previous spring testing and norms for the following spring. Second grade students were tested in reading and arithmetic in the fall and in the spring to provide pre-test and post-test data for evaluation of academic growth. Three…

The relationship between the Instructional Process, Instructional Objectives, and Assessment Tasks, identified at the School City of Gary, Indiana, necessitate an effective testing program. Four characteristics perceived crucial to a sound program were: (1) The program should be continuous, (2) The testing program should be comprehensive, (3)…

This text on the assessment of students with disabilities focuses on accuracy in assessment and testing and the need for functional and meaningful assessment practices. The 14 chapters are grouped into 4 major parts. The first part, "An Introduction to Assessment," describes a comprehensive evaluation and discusses the mandatory…

A central problem for the user of domain-referenced tests in instruction is deciding who has passed and who has failed. Two procedures were presented and discussed. The first, employing classical test theory, was found to be more useful for larger domains and where the passing standard is 70 percent or less. The sampling procedure suggested by…