The interrater reliability for 33 pairs of evaluators of a group assessment procedure developed from assessment center techniques was supported in 3 studies in Israel (admission to a counseling program for 109 candidates, admission of 94 candidates to teacher training, and selection of 69 candidates for Army teaching posts). (SLD)

The Inattention and Hyperactivity-Impulsivity factors of the Attention Deficit Hyperactivity Disorder Rating Scale-IV were used to predict diagnostic status of 147 referred elementary school students. Results suggested that using a single informant was best for ruling out Attention Deficit Hyperactivity Disorder (ADHD) and using parent and teacher…

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

A behavioral assessment system for scoring the behaviors of parents and coaches at youth sports games is described within this paper. The Youth Sports Behavior Assessment System (YSBAS) contains nine behavioral categories describing behaviors commonly seen during youth sports. The developmental process of YSBAS and the observer-training program…

This paper, drawing on work with three integrated early years centres, designated as centres of excellence in the north of England, addresses issues arising from the evaluation of a government initiative in funding models of integrated services and good educare practice. Issues concerned with evaluation work and the difficulties in investigating…

This paper presents a case study which illustrates the author's experience as a sole proprietor taking on the collegial roles of both learning partner and coach, using an evaluation capacity-building strategy she called an evaluation learning circle (ELC). Facilitating the ELC was one of a variety of tasks she conducted as part of a multiyear…

The author describes potential evaluation capacity-building activities in contrast to the specifics of an evaluation design. Her response to the case of the Bunche-Da Vinci Learning Partnership Academy is developed in three parts: (1) an initial framing of the Bunche-Da Vinci situation; (2) what should be done before signing a contract; and (3)…

This fact sheet summarizes data gathered in the 2008 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by The Evaluation Center at Western Michigan University, this was the ninth annual survey of ATE projects and centers. Included here are statistics about the program's grantees and…

This study evaluated agreement between expert system and human scores on 12 algebra word problems taken by Graduate Record Examinations (GRE) General Test examinees from a general sample of 285 and a study sample of 30. Problems were drawn from three content classes (rate x time, work, and interest) and presented in four constructed-response…

This paper addresses the main issues related to concepts of school effectiveness and their implications, with a focus on the selection of school-performance indicators. School effectiveness has many definitions, which is in part due to the different demands made by various social groups. The boundaries of performance within which schools should…

Almost 30 independent tribally-controlled colleges are chartered in a dozen states and Canada. It is essential that tribal college evaluators develop the cultural sensitivity to accept and respect the tribal college environment and develop an appreciation for the uniqueness of these institutions. Tribal colleges have unique missions, which include…

The validation of key contextual features of algebra word problems was studied in two phases. In the first phase, five experts were asked to assess the appropriateness of the concepts in the problems and the adequacy of the assignment of the contextual features to the problems. In the second phase, construct validity was established by having 6…

This paper discusses a number of interventions that are aimed at increasing educational opportunities of homeless students in the United States. Only a few of these programs have been locally evaluated, and the evaluation process is particularly challenging for local evaluators to undertake. At a state and national level, commitment to evaluation…

This paper examines the many facets of administrative information management on the college or university campus. It is argued that, depending on the situation, an effective information manager can adopt the outlook of an architect/designer, data administrator, editor, analyst, reporter, planner, broker, collaborator, interpreter, or marketer.…

To fulfill a mandate of the Tennessee State Legislature, the extent to which the Tennessee Career Ladder System (CLS) is valid for making inferences about the professional competence of teachers was investigated. Evidence of the extent to which the content of the evaluation procedures reflects sound theory, empirical findings, and best practices,…