Programme evaluation has developed tremendously over the past 50 years, with a proliferation of evaluation research, an increase in the institutionalization of evaluation, and growth in the professionalization of evaluation. However, existing research and developments are still largely in North America, Europe, Australia, and New Zealand, with…

The focal paper by Baird et al. in this special issue argues that there are few issues more important in education than the relationship between assessment and learning. On the one hand, learning is the ultimate goal of all educational interventions; on the other, assessment has become a leviathan that constrains and shapes virtually all of that…

In this commentary, Mary James highlights two problems she deemed critical during her work exploring the relationships between assessment and learning in theory and practice. First, efforts to improve assessment for learning were not always successful either in improving performance or in other ways. Second, and this may be a reason for the first…

We present a case to reposition theory so that it plays a pivotal role in learning technology research and helps to build an ecology of learning. To support the case, we present a critique of current practice based on a review of articles published in two leading international journals from 2005 to 2010. Our study reveals that theory features only…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

The field of intelligence testing has been revolutionized by Alan S. Kaufman. He developed the Wechsler Intelligence Scale for Children-Revised (WISC-R) with David Wechsler, and his best-selling book, Intelligent Testing with the WISC-R, introduced the phrase "intelligent testing." Kaufman, with his wife, Nadeen, then created his own…

This paper provides the basis for understanding score equating through item response theory (IRT). Theoretical justifications and practical advantages of IRT true-score test procedures are discussed. Three steps in the equating process are specified, and a self-test is included. (SLD)

An expanded framework for validating tests is needed to include the perspectives of teachers and students as well as of test makers and scientists. The development of educational assessments must take place within an understanding of how tests are used in context. (SLD)

The concept of a behavior domain is a reasonable and essential foundation for psychometric work based on true score theory, the linear model of common factor analysis, and the nonlinear models of item response theory. Investigators applying these models to test data generally treat the true scores or factors or traits as abstractive psychological…

This text was written to help the reader acquire a base of knowledge about classical psychometrics and to integrate new ideas into that framework of knowledge. The material is organized into five units: (1) introduction to measurement theory; (2) reliability; (3) validity; (4) item analysis in test development; and (5) test scoring and…

The Stanford-Binet Intelligence Scale: Fourth Edition is a conceptually new version of this traditional intelligence scale. The new scale has a solid basis in theory, but there is little evidence that the Binet matches its intended theory. This study was designed to determine whether the Binet corresponds to the theory that guided its…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

Examines accuracy evaluation in published testing programs of the following: J. M. Cattell; C. Spearman; A. Binet; L. M. Terman; R. M. Yerkes; E. L. Thorndike; and W. D. Scott. Developing community and consensus on testing required convergence between theorists and practitioners. (SLD)

Examines the concept of authenticity and the way this notion has evolved in language testing and general education. Presents a study looking at the importance of authenticity for test takers, and shows that test takers are willing and able to identify the attributes of a test likely to affect their performance. More research is needed if the…

Originally developed for the Department of Defense Schools (DoDDS) system, this learning package on changing perspective in reading assessment is designed for teachers who wish to upgrade or expand their teaching skills on their own. The package includes a comprehensive search of the ERIC database; a lecture giving an overview on the topic; the…