Large-scale language testing uses statistical information to account for the quality of an assessment system. In this reflection article, I explain how basic statistics can be used meaningfully in the context of classroom language assessment. The paper explores a series of statistical calculations that can be used to examine test scores and…

Fifty years ago, Robert Glaser introduced the concept of criterion-referenced measurement in an article in American Psychologist. Its early proponents predicted that this measurement strategy would revolutionize education. But has it lived up to its promise? W. James Popham explores this question by looking at the history of criterion-referenced…

In adolescence research, the treatment of measurement reliability is often fragmented, and it is not always clear how different reliability coefficients are related. We show that generalizability theory (G-theory) is a comprehensive framework of measurement reliability, encompassing all other reliability methods (e.g., Pearson "r,"…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

Describes a procedure, called a full Bayesian procedure, for making decisions in connection with criterion-referenced measurements. The procedure uses continuous utility functions instead of a dichotomized utility structure and combines the posterior distribution for a certain person with utility functions for "advance" and "retain" decisions…

Describes procedure for combining Stanford Achievement Test items with local supplementary items to measure individual and aggregate student performance in mathematics. Two reports are generated from the test results: a diagnostic report of student mastery of each objective and an overall score. (TE)

Explains and contrasts the techniques and philosophies of norm-referenced (NRT) and criterion-referenced tests (CRT). NRTs are criticized for lack of useful information and control. CRTs are usually teacher-made and customized to fit the classroom needs, offering more control over test content, but few teachers are prepared to develop them. (SM)

Because testing, in many different forms, currently plays such an important role in education, Elementary Secondary Education Act, Title I, the Division of Federal Assistance in the Vermont State Department of Education, prepared this brochure to present a general introduction to terms and phrases commonly used in testing and to highlight some of…

Assigning grades is an integral part of social work education. However, social work educators must decide whether to use norm-referenced or criterion-referenced measurements to grade exams and other assignments. This paper presents arguments for grading with both norm-referenced and criterion-referenced measurements. The benefits of…

Rasch model statistics and domain-referenced test development methods were used in the Virginia Basic Learning Skills (BLS) testing programs and the Graduation Competencies testing program in order to increase the fairness and effectiveness of those programs. Mastery of each of the 83 objectives in reading and mathematics for grades one through…

Presents major stages in design and development of criterion referenced tests (CRT) with emphasis on differences between CRT construction and norm-referenced test construction. Discussion covers test interpretation; test theory; preparation for test construction (hierarchical analysis, item type selection, and choosing number of items); test…

I discuss the contributions of Harvey Siegel, Francis Schrag and Randall Curren to this volume. Their articles cast in bold relief the relation of High Stakes Testing to the goals of education, the nature of mind and the demands of justice. I argue that the connections are deep, but that the considerations these authors raise do not show that High…

A statewide sample testing of writing skills in the fourth, seventh, and tenth grades was conducted by the Michigan Educational Assessment Program in the fall of 1982. This report, which shares the writing assessment information (historical, descriptive, and interpretive) for educational decision-making, was prepared in the hope of increasing…

Using the Role Delineation study as the basis (see CE 031 628), a project developed a criterion-referenced self-assessment examination for physican assistants (PAs) from which appropriate continuing education could be developed. Working committees consisting of PAs and PA educators first developed five 80-item test sections and then 315 items…

This manual is designed to accompany reports prepared by the Pennsylvania Department of Education for the 505 school districts in that state, summarizing results of the Educational Quality Assessment. The normative sample is described as being stratified on two dimensions: district enrollment and wealth. Administrative procedures are summarized.…