Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

The use of data to inform decisionmaking and practice at the school and district levels is now a common feature of reform efforts. Advances in districts' technological capacities have produced data systems that allow a flow of data to and from schools, often to the point of creating an overwhelming flood of information. To make the flow of…

The importance of higher education has never been clearer. Educational attainment--the number of years a person spends in school--strongly predicts adult earnings, as well as health and civic engagement. Yet relative to other developed nations, educational attainment in the United States is lagging, with young Americans who heretofore led the…

Examining evaluation theory in cultural context is an important component of evaluating theory; however, it is not the ultimate goal. The foundational element in good evaluation is validity, and appreciating the cultural location of evaluation theory is an important building block in the argument supporting multicultural validity. Multicultural…

Assessments labeled as formative have been offered as a means to improve student achievement. But labels can be a powerful way to miscommunicate. For an assessment use to be appropriately labeled "formative," both empirical evidence and reasoned arguments must be offered to support the claim that improvements in student achievement can be linked…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

A discussion of current issues in evaluation, related to society's expectation that evaluation is based on scientific authority, is followed by an exploration of concepts of "validity" and "values." The role of the evaluator is increasingly involved in issues of ethics and social justice. (SLD)

In many school districts, the pressure to raise test scores has created overnight celebrity status for formative assessment. Its powers to raise student achievement have been touted, however, without attending to the research on which these claims were based. Sociocultural learning theory provides theoretical grounding for understanding how…

Provides an argument for incorporating consideration of consequences into validity theory that is grounded in the reflexive nature of social knowledge. It also calls for the consideration of evidence of validity based on the actual discourse surrounding the practices and products of testing. (SLD)

The construct "multicultural validity" is proposed as the vehicle for organizing concerns about pluralism and diversity in evaluation and as a way to reflect on the cultural boundness of evaluation. It should be conceptualized as a central dimension of validity and a viable focus of concern in evaluation theory. (SLD)

This paper proposes a model to establish which criteria are considered by stakeholders as valid for evaluating a program. The model is developed with the aim of increasing the credibility and use of evaluations. Stakeholders are involved in the identification of potential evaluation criteria, and ratings of validity and priority are used as the…

A study of school district uses of evaluation and test data is used to illustrate the variety of ambiguities that can appear in qualitative data. Rules of evidence to distinguish valid and potentially nonvalid testimony are proposed. Uses of testimony in evaluation are discussed. (BS)

A professional support personnel evaluation model is presented that is grounded in sound evaluation theory and conceptualized in research as well as practice. Validity, reliability, and utility are acknowledged in the seven steps of an evaluation model that balances institutional and individual needs. (SLD)

A reorganized version of standards to be utilized for those who are involved with educational evaluation in Brazil was the result of a critical review of evaluation standards which were originally elaborated by the Joint Committee on Standards for Educational Evaluation. The conceptual framework for the critical review comprised logical…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…