Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Forty-two states and the District of Columbia have recently received waivers to the school accountability requirements of the No Child Left Behind Act (NCLB). As the prospects for reauthorizing the Act in the near term are dim, these new accountability systems will be law for at least several years. Drawing on a four-part framework from the…

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…

"The Multiple Intelligences Developmental Assessment Scales" (MIDAS) is a self- (or other-) completed instrument which is based upon the theory of multiple intelligences. The validity, reliability, and utility data regarding the MIDAS are reported here. The measure consists of 7 main scales and 24 subscales which summarize a person's intellectual…

This paper presents a primer on building a scientifically oriented teacher evaluation instrument. It stresses the importance of accurate measures and accepts the presupposition that scientific approaches provide the most accurate measures of student teacher performance. The paper discusses the scientific concepts of validity and reliability, and…

The Child Behavior Checklist (CBCL) is used to assess the behavioral problems and social competencies of children. Its broad usage in both practitioner and research contexts has led to misapplications as compared to the CBCL's original intended purpose. In addition, the composition of the normative sample presents particular difficulties for…