Large-scale language testing uses statistical information to account for the quality of an assessment system. In this reflection article, I explain how basic statistics can be used meaningfully in the context of classroom language assessment. The paper explores a series of statistical calculations that can be used to examine test scores and…

Fifty years ago, Robert Glaser introduced the concept of criterion-referenced measurement in an article in American Psychologist. Its early proponents predicted that this measurement strategy would revolutionize education. But has it lived up to its promise? W. James Popham explores this question by looking at the history of criterion-referenced…

In adolescence research, the treatment of measurement reliability is often fragmented, and it is not always clear how different reliability coefficients are related. We show that generalizability theory (G-theory) is a comprehensive framework of measurement reliability, encompassing all other reliability methods (e.g., Pearson "r,"…

The assessment of young children in early childhood special education is a central area of educational practice. The results of child assessments often have significant implications for young children, their families, and the programs that serve them, including eligibility for special education services, instructional planning, and documentation…

Scores are the most visible and widely used products of a testing program. The choice of score scale has implications for test specifications, equating, and test reliability and validity, as well as for test interpretation. At the same time, the score scale should be viewed as infrastructure likely to require repair at some point. In this report…

The types of test score interpretive information considered useful to failing examinees were studied through interviews with Educational Testing Service (ETS) staff members. Research literature on interpretive information for failing test takers was reviewed, and procedures currently used at ETS were determined. Managers of 23 testing programs…

Techniques for classifying individuals into mastery or non-mastery status based on criterion-referenced test performance are investigated. Extensions of mastery classification techniques developed by Macready and Dayton are presented. The techniques are based on latent class and quasi-independence models. (Author/JKS)

In keeping with the theme of the International Language Testing Association/Language Testing Research Colloquium Conference in 2008, "Focusing on the Core: Justifying the Use of Language Assessments to Stakeholders," I define "stakeholder-friendly tests," "defensible testing," and "testing-context analysis."…

Addresses the issue of counselor expertise in test interpretation. Discusses norm-referenced versus criterion-referenced interpretation, interpreting the precision of the information, interpreting the meaning of the construct and its relevance to the decision, and general precautions regarding test interpretation. (LLL)

A method for obtaining criterion-references information from standardized tests is proposed. (TA)

When comparing examinees to a control group or person, the examiner usually does not know the probability of correct classification based on the number of items used and the number of people tested. Using ranking and selection techniques, a framework is described for deriving a lower bound on this probability. (Author/JKS)

There is no conflict between interpretation of criterion-referenced tests, interpretation of norm referenced tests, and the SAT, nor should on be thought superior to the other in some sense. Each should supplement the other. (Author/PG)

Criterion-referencing is a way to enhance the interpretation of test scores by referencing them to well-defined behavior domains. Behavior domains may be ordered or unordered; several varieties of criterion-referenced tests within each of these types are discussed. (Author/RL)

To realize the dividends from the relationship between testing and teaching, teacher and administrator preparation and inservice training must be redesigned so that professionals are equipped to interpret results from norm-referenced and criterion-referenced tests designed by experts. (JOW)

Seventeen statistics for measuring the reliability of criterion-referenced tests were critically reviewed. The review was organized into two sections: (1) a discussion of preliminary considerations to provide a foundation for choosing the appropriate category of "reliability" (threshold loss function, squared-error loss-function, or…