Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

In "Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art," Rupp and Templin (2008) undertake the ambitious task of providing a thorough portrait of the current state of diagnostic classification models (DCM). In this commentary, the author applauds Rupp and Templin for their…

In this commentary, the author addresses what is referred to as the deterministic input, noisy "and" gate (DINA) model. The author mentions concerns with how this model has been formulated and presented. In particular, the author points out that there is a lack of recognition of the confounding of profiles that generally arises and then discusses…

Rupp and Templin (2008) do a good job at describing the ever expanding landscape of Diagnostic Classification Models (DCM). In many ways, their review article clearly points to some of the questions that need to be answered before DCMs can become part of the psychometric practitioners toolkit. Apart from the issues mentioned in this article that…

In this commentary, the authors discuss some of the issues regarding the use of diagnostic classification models that practitioners should keep in mind. In the authors experience, these issues are not as well known as they should be. The authors then provide recommendations on diagnostic scoring.

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

The author began his education career committed to curriculum, not measurement. After years of using teacher-made and standardized tests as instructional afterthoughts, he recognized the superiority of criterion-referenced testing and the influence of high-stakes testing on instruction. He then became involved with developing such tests on a…

Mastery learning strategies and criterion referenced measurement tools perform a selective function in the classroom. The selective approach within the philosophical role of schools is discussed in terms of limited educational employment, competition, talent distribution, and the suggested attributes of good testing. (CM)

Norm-referenced testing is not appropriate for use in teacher evaluation. A truly equitable method of teacher evaluation is based on a clear set of instructional targets and on the teacher's effectiveness in helping students master the specific skills and knowledge targeted. (Author/MLF)

An outcome of the excellence movement has been an increase in state control of education, especially through state-mandated testing, as testing has become the preferred means of trying to effect change in education following the popularity of accountability and minimum competency testing. Suggestions for using tests prudently are listed. (DCS)

An introductory analysis of the relative faults and merits of various testing systems suggests the need for teacher intercession in the standard testing procedure. (LH)

The author defines criterion-referenced (CRT) and norm-referenced (NRT) tests, considers current objections to each, and distinguishes their appropriate uses: CRTs for pupil diagnosis and instruction and NRTs for surveying achievement in a long-term evaluation context. Part of a theme issue on student assessment. (SJL)

Focusing on technical issues, this paper critiques proposed changes in assessment procedures at the further educational level (ages 16 through 18) in England and Wales. Major structural changes are taking place at this educational level, partly because of large scale youth unemployment. The two current examination systems for the final year of…

Popham describes the evolution of his Instructional Objectives Exchange (IOX) from an objectives-dispensing enterprise to an assessment-creating enterprise. Discusses national standardized testing, criterion-referenced versus norm-referenced assessment, teacher licensure tests, and professional development activities for graduate students. (KS)

A wave of criticism has been leveled at standardized achievement tests of basic skills. Part of the debate concerns the types of tests administered, such as the Standardized/Norm-Referenced tests, Criterion-Referenced tests, Minimum Competency tests, National Assessment of Educational Progress tests, alternatives to standardized tests, IQ tests,…