This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

The intervention validity of cognitive assessment batteries is considered within an historical context to identify what the evidence supports (knowns), what cannot be known (unknowables), and what is not yet known (unknowns). Two ways cognitive batteries could inform intervention are identified: a disordinal (i.e., aptitude-treatment interaction)…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

Provides an argument for incorporating consideration of consequences into validity theory that is grounded in the reflexive nature of social knowledge. It also calls for the consideration of evidence of validity based on the actual discourse surrounding the practices and products of testing. (SLD)

This paper proposes a model to establish which criteria are considered by stakeholders as valid for evaluating a program. The model is developed with the aim of increasing the credibility and use of evaluations. Stakeholders are involved in the identification of potential evaluation criteria, and ratings of validity and priority are used as the…

This article reviews experiences in the United States over the past 15 years in developing standards to guide and assess the work of professional evaluators. It introduces the Joint Committee on Standards for Educational Evaluation's "Program Evaluation Standards" and overviews the Committee's project to develop "Educational…

A reorganized version of standards to be utilized for those who are involved with educational evaluation in Brazil was the result of a critical review of evaluation standards which were originally elaborated by the Joint Committee on Standards for Educational Evaluation. The conceptual framework for the critical review comprised logical…

Ways to improve the validity of assessment of college students are discussed. Validity problems often have occurred because the purpose of assessment was not clear. Traditionally, college students have been tested for admission and placement. However, the results of these tests have been used for other purposes, such as comparing institutions.…