The purpose of this paper is to provide an alternative operationalization of amenities that does not privilege certain kinds of natural resources and climatic conditions and that can be used for assessing the quality of life in small towns. The amenity inventory presented here extends previous literature by including a broad range of amenities…

Since its inception, the National Center for Education Statistics (NCES) has been committed to the practice of documenting its statistical methods for its customers and of seeking to avoid misinterpretation of its published data. The reason for this policy is to assure customers that proper statistical standards and techniques have been observed,…

This paper describes a model proven to be effective for assessing and documenting evidence of student learning outcomes. Specifically, it will share a model, F.A.M.O.U.S. Copyright ©2008, which is an acronym exemplifying six effective steps for complying with institutional accountability and eternal assessment requirements proscribed by the…

University rankings are having a profound effect on both higher education systems and individual universities. In this paper we outline these effects, discuss the desirable characteristics of a good ranking methodology and document existing practice, with an emphasis on the two main international rankings (Shanghai Jiao Tong and THES-QS). We take…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…

Describes six inquiries in the social sciences, both old and new, that show how evaluation can be conducted and what it can achieve. Draws six lessons from these studies that should lead to an evaluation culture that is more painstaking and an evidence base that is more cumulative. (SLD)

The "U.S. News & World Report" (USNWR) rankings have become the "gold standard" of the college ranking business. College and university presidents proclaim that these rankings are not a measure of the quality of their institutions and that they do not pay attention to the rankings, but, in fact, institutions are very…

This handbook presents current explanations of how each survey program of the National Center for Education Statistics (NCES) obtains and prepared the data it publishes. The handbook aims to provide users of NCES data with the most current information necessary to evaluate the suitability of the statistics for their needs, with a focus on the…

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

Strategies for enhancing the social relevance of evaluation research concerning community-based residential services for individuals with severe learning difficulties or with serious psychiatric disabilities focus on: reflection of cultural values in the residential environment; number of service users living in the community; and the quality of…

Evaluation synthesis, a meta-evaluation method developed by the General Accounting Office to improve evaluation utilization by legislators, is described. It is designed to: (1) focus on the information needs and priorities of legislators, and (2) ensure continuous communication between sponsor and evaluator. The strengths and limitations of this…

Aiming to encourage longitudinal studies in science education, we clarify conceptual and methodological aspects of longitudinal research. We use the studies that other articles in this issue describe to illustrate these aspects. The illustrations range from attempts to promote long-term change through experimental teaching to investigations that…

Evaluation activities in China are examined, focusing on housing reform. How evaluation functions in justifying the political initiatives of the Chinese Communist Party is explored, and the possibility that evaluation research can become an academic field in China using Western methodology is discussed. (SLD)

Discusses the limitations of laboratory research in evaluating second language instruction, arguing that field research, which fosters a concern for what works in the classroom first, is more desirable because it provides direct feedback to instructors. (Author/CB)