The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

A behavioral assessment system for scoring the behaviors of parents and coaches at youth sports games is described within this paper. The Youth Sports Behavior Assessment System (YSBAS) contains nine behavioral categories describing behaviors commonly seen during youth sports. The developmental process of YSBAS and the observer-training program…

This paper, drawing on work with three integrated early years centres, designated as centres of excellence in the north of England, addresses issues arising from the evaluation of a government initiative in funding models of integrated services and good educare practice. Issues concerned with evaluation work and the difficulties in investigating…

This paper presents a case study which illustrates the author's experience as a sole proprietor taking on the collegial roles of both learning partner and coach, using an evaluation capacity-building strategy she called an evaluation learning circle (ELC). Facilitating the ELC was one of a variety of tasks she conducted as part of a multiyear…

The author describes potential evaluation capacity-building activities in contrast to the specifics of an evaluation design. Her response to the case of the Bunche-Da Vinci Learning Partnership Academy is developed in three parts: (1) an initial framing of the Bunche-Da Vinci situation; (2) what should be done before signing a contract; and (3)…

This issue of "The Evaluation Exchange" describes new developments in evaluating advocacy and policy change efforts that attempt to inform or influence public policy at the local, state, or federal levels. Heather B. Weiss introduces the themes in this issue in "From the Director's Desk," examining how evaluation of advocacy…

In this article, the authors trace the emergence of an institutional discourse of ethical research and interrogate its effects in constituting what ethical research is taken to be and how ethical researchers are configured. They illuminate the dissonance between this regime of truth and research practice and the implications for the injunction to…

This fact sheet summarizes data gathered in the 2008 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by The Evaluation Center at Western Michigan University, this was the ninth annual survey of ATE projects and centers. Included here are statistics about the program's grantees and…

This study evaluated agreement between expert system and human scores on 12 algebra word problems taken by Graduate Record Examinations (GRE) General Test examinees from a general sample of 285 and a study sample of 30. Problems were drawn from three content classes (rate x time, work, and interest) and presented in four constructed-response…

This paper addresses the main issues related to concepts of school effectiveness and their implications, with a focus on the selection of school-performance indicators. School effectiveness has many definitions, which is in part due to the different demands made by various social groups. The boundaries of performance within which schools should…

Almost 30 independent tribally-controlled colleges are chartered in a dozen states and Canada. It is essential that tribal college evaluators develop the cultural sensitivity to accept and respect the tribal college environment and develop an appreciation for the uniqueness of these institutions. Tribal colleges have unique missions, which include…

The validation of key contextual features of algebra word problems was studied in two phases. In the first phase, five experts were asked to assess the appropriateness of the concepts in the problems and the adequacy of the assignment of the contextual features to the problems. In the second phase, construct validity was established by having 6…

This paper discusses a number of interventions that are aimed at increasing educational opportunities of homeless students in the United States. Only a few of these programs have been locally evaluated, and the evaluation process is particularly challenging for local evaluators to undertake. At a state and national level, commitment to evaluation…

This paper examines the many facets of administrative information management on the college or university campus. It is argued that, depending on the situation, an effective information manager can adopt the outlook of an architect/designer, data administrator, editor, analyst, reporter, planner, broker, collaborator, interpreter, or marketer.…

To fulfill a mandate of the Tennessee State Legislature, the extent to which the Tennessee Career Ladder System (CLS) is valid for making inferences about the professional competence of teachers was investigated. Evidence of the extent to which the content of the evaluation procedures reflects sound theory, empirical findings, and best practices,…