In this commentary, the author addresses what is referred to as the deterministic input, noisy "and" gate (DINA) model. The author mentions concerns with how this model has been formulated and presented. In particular, the author points out that there is a lack of recognition of the confounding of profiles that generally arises and then discusses…

Rupp and Templin (2008) do a good job at describing the ever expanding landscape of Diagnostic Classification Models (DCM). In many ways, their review article clearly points to some of the questions that need to be answered before DCMs can become part of the psychometric practitioners toolkit. Apart from the issues mentioned in this article that…

In this commentary, the authors discuss some of the issues regarding the use of diagnostic classification models that practitioners should keep in mind. In the authors experience, these issues are not as well known as they should be. The authors then provide recommendations on diagnostic scoring.

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

Comparison of student test scores between states, school districts, and even schools continues to be a popular measure of student achievement. However, these comparisons reveal little about the quality or effectiveness of educational programs, only the varying difficulty of educating different populations of students. This report uses U.S. Census…

Describes assessment in the German school system as regular, systematic, and officially controlled through legislation. Emphasizes that even strict grading levels combine criterion and norm referencing because teacher determination must include a subjective element. Concludes that other systems may best learn negative lessons from the German…

The author offers some thoughts on commentator's reactions to the substance of the measures, particularly those about measuring teacher learning and change, based on the major uses of the measures, and because this is a significant challenge facing test development as an enterprise. If teacher learning results in more integrated knowledge or…

Ways to improve the validity of assessment of college students are discussed. Validity problems often have occurred because the purpose of assessment was not clear. Traditionally, college students have been tested for admission and placement. However, the results of these tests have been used for other purposes, such as comparing institutions.…

In this article, the author echoes his co-author's and colleague's pleasure (Hill, this issue) at the thoughtfulness and far-ranging nature of the comments to their initial attempts at test validation for the mathematical knowledge for teaching (MKT) measures using the validity argument approach. Because of the large number of commentaries they…

Can caring and standardized testing coincide? Marcuse criticized the misuse of science because it also legitimizes social and economic hierarchy. By the same token, scholars develop standardized testing, claiming these tests are scientific and can measure objectively individuals' learning and intelligence capabilities. However, if inclusive caring…

Certain types of evaluation tools used in continuing education offerings limit the evaluation process and hence the value of the offering. Asking a yes/no question as an exclusive evaluation method for learners' achievement of objectives is inappropriate for certain types of offerings. Provision should be made for assessment of continuing…

Accrediting associations assess colleges in order to find out what has been accomplished, and to find out how it might be better accomplished. Assessment of educational outcomes can be a useful way to demonstrate the success of alternative means. However, accrediting agencies do not rely exclusively on outcome measures, since they only assess what…

The value-added approach to the assessment of student outcomes examines actual or inferred changes in students' performance over time. It also attempts to separate the net effects of instruction from previous ability or simple maturation. Others may have different definitions of this concept, and this vagueness causes problems. Suggested ways to…

The Board of Regents of South Dakota's public colleges and universities decided in 1984 to implement a Value-Added Testing program (an exit test required for graduation) modelled on the Northeast Missouri State University plan. The plan was intended to increase student learning, improve curricular design, and encourage excellent teaching.…

School and government officials, system administrators and other policymakers offer a variety of reasons for engaging in high stakes testing: to monitor student performance, to measure teacher and/or school effectiveness, to ensure accountability, etc. Some of these reasons are good; others not. But the best reason--one that is never offered,…