Whether adequate levels of interrater reliability could be obtained on a national, standardized examination using one examiner per observation was studied with 101 paired candidate observations on an examination for optometry. Results indicate that psychometrically sound judgments can be obtained with one examiner. (SLD)

Discusses the development of a foreign language (Spanish) test battery that was designed for two purposes: to place students in study-abroad programs appropriate to their language ability and to provide information on designing useful instruction for prospective study-abroad students. Results are presented into task and rater variability in the…

To help evaluators find the right measurement instrument, this annotated bibliography lists 46 compendia listing, reviewing, or presenting instruments devoted to (1) psychological/behavioral assessment; (2) mental health; (3) physical health; (4) sociological scales; (5) attitudinal scales; (6) observational measures; (7) standardized tests; and…

Mothers, fathers, teachers, and speech therapists rated improvement in communication skills of 11 young children (ages 3-5) with autism following one year of intensive treatment. Results found fathers, teachers, and speech therapists in significant agreement with a psychometric measure of speech and language, whereas mothers' ratings bore no…

Implications of the research findings of nine papers on instruction in higher education are discussed. Faculty development is defined, and some methods of teacher evaluation that have been successful in improving teacher effectiveness are described. Emphasis is placed on the "class-side manner" of the faculty developer. (SLD)

Describes the rise and evolution of educational evaluation, discussing trends in evaluation that have emerged since 1970 and projecting these trends into tentative estimates for 1991-2010. Paradigmatic and methodological shifts in evaluation that have affected today's educational evaluation are examined. (SM)

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)

Events that brought independent evaluators together to address common problems and issues in the area of Acquired Immune Deficiency Syndrome (AIDS) education are described, focusing on development and accomplishments of the collaboration. The foundation stemmed from the funding agency's insistence that each program identify an evaluator. (SLD)

Although it is recognized that ESL students often need assistance to become more comprehensible speakers, their teachers usually have limited time to devote to pronunciation instruction. Research should help teachers set priorities for pronunciation teaching to address these students' needs as efficiently as possible. Here we test the usefulness…

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

Hiring savvy teachers requires interviewers to assess more than candidates' willingness to do the job, love of students, and ability to fit into the climate of the school. Beyond these qualities, an important question remains and that is if the candidates have the assessment skills to be effective in this new age of test scores, accountability,…

Educational software makers are often rebuffed by educational authorities, whose endorsements could lead to governmental stamps of approval, and thus explosive sales. But they usually get warmer receptions in the offices of the nation's school superintendents, who are, after all, their primary customers. The system was not supposed to work this…

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…

A checklist for critiquing participatory planning and evaluation projects is introduced. Under the legislative mandate of "Florida Blueprint 2000: A System of School Improvement and Accountability," Florida schools must reorganize before the year 2000 by involving and connecting stakeholders in improvement processes. Every public school…