Seven articles highlight evaluations that are especially investigative in nature to examine how common elements in these studies can be used to improve evaluation and practice. The evaluator is seen as detective, ethnographer and management consultant, national program monitor and analyst, and international development specialist. (SLD)

Synthesizes discussions that occurred among a consortium of professionals responsible for the evaluation of early-intervention programs and highlights issues emerging from state-level evaluations of early-intervention programs in the context of six different areas: measures, outcomes, service integration, eligibility, funding models, and cost…

Describes a federally funded partnership between Northeastern Illinois University and Chicago Public Schools to provide an inner-city family literacy program. Details program components, highlighting use of computers, video technology, and photography as tools to develop literacy and to document progress of parents and children. Notes evaluation…

Too often school counselors are evaluated through a teacher-assessment process bearing little relevance to (poorly defined) counseling tasks or roles. Evaluation is hindered by lack of a developmental model and by administrative pressures to perform tasks outside counselors' training and experience. Improvement measures are outlined. (Contains 16…

A study of 13 national and state data collection programs examined the exclusion of students with disabilities from data collection programs evaluating student educational outcomes. Eight recommendations are offered for improving the collection and reporting of information in state and national data collection programs. (Author/CR)

A survey of 49 university and other research administrators investigated attitudes concerning research productivity and measures to assess it. Results are compared with those of an earlier survey of research scientists, including a rank-order comparison of the relative importance of a number of productivity measures. Implications for demonstrating…

Issues related to the establishment of formal standards for student achievement on large-scale assessments are discussed, and two approaches to standard setting that have been used in Saskatchewan (Canada) are described. In spite of the general success of these programs, numerous issues to consider in future evaluations are raised. (SLD)

This article reviews goal attainment scaling as an alternative method for evaluating treatments for children with autism. It discusses the use of goal attainment scaling as a way to provide a convergent link between outcome goals and program goals within a framework of family-centered practices. A case study is provided. (Author/CR)

Different aspects of diversity have been explored in order to assess whether preservice teachers are being prepared to meet the needs of their diverse student population. Diversity continues to be examined in a fragmented way by looking at issues separately. It seems necessary that prior to assessing preservice teachers' competence in diversity,…

The cognitive abilities of 24 males at an in-patient substance abuse facility were assessed using the Neurobehavioral Cognitive Status Examination (Cognistat). Findings suggested that there were significant changes in cognitive functioning during the 21-day in-patient treatment as measured by the Cognistat. Implications for mental health…

In this article, a new method is presented and implemented for deriving a scale of socioeconomic status (SES) from international survey data using a multilevel Bayesian item response theory (IRT) model. The proposed model incorporates both international anchor items and nation-specific items and is able to (a) produce student family SES scores…

In its effort to simplify the accreditation process, the National Council for Accreditation of Teacher Education has limited the amount of documentation that a program can use to support its efforts for accreditation. With this "no frills" approach, the rubrics or scoring guides that accompany assessments provide critical information about the…

Reliance on subjective grant proposal review methods leads private philanthropies to underfund mental health programs, even when foundations have mental health focuses. This article describes a private mental health foundation's efforts to increase the objectivity of its proposal review process by developing a reliable, valid proposal rating form.…

Higher education is influenced significantly by regional and disciplinary accrediting organizations. Regional accrediting organizations accredit entire institutions, while disciplinary accreditors approve programs within those institutions. All accrediting organizations require institutions and programs to examine their educational effectiveness…

Latent semantic analysis (LSA) is an automated, statistical technique for comparing the semantic similarity of words or documents. In this article, I examine the application of LSA to automated essay scoring. I compare LSA methods to earlier statistical methods for assessing essay quality, and critically review contemporary essay-scoring systems…