Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

Recognition of prior learning (RPL) has been an important element of Australia's Vocational Education and Training (VET) policy since it was officially adopted as a key national principle in 1991 (VEETAC 1991, cited in Wilson and Lilly 1996:2). The aim of RPL is to formally assess a person's skills gained through life and work experience, in order…

The commentary and overview explored how curriculum and assessment reforms are being used by a small university and small country to improve the quality of education and gain international recognition. Although the reforms are potentially beneficial to the students, university, and country, there are dilemmatic factors that may either enhance or…

A number of brief papers are presented to provide guidelines for test directors of school systems. This collection is intended for both newly appointed and experienced directors. Contributions were solicited from practicing directors of testing; the authors include Anthony J. Allen, Margaret Backman, Joan Bollenbacker, Gerald Hanna, James Lawson;…

Several issues are related to the use of educational tests. First, test users must be able to choose appropriate tests, interpret scores, and make decisions based on scores. In the field of educational testing, few test users have adequate training in these areas. Second, test makers must clearly specify directions for administration, allowable…

This study examined the relationships between the evaluations obtained from standard setting panelists and changes in ratings between different rounds of a standard setting study that involved setting standards on different language versions of an exam. We investigated panelists' evaluations to determine if their perceptions of the standard…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

Although much has been written about educational evaluation, few guidelines exist for consumers--project directors, school administrators, curriculum developers, legislators, teachers, parents, and boards of education. Several cautions surface from a review of the literature. First, tests that are based on program objectives are most useful to…

This paper represents a tribute to the career of Ralph Winfred Tyler, whose publication "Constructing Achievement Tests" served as the basis for most of the major efforts in evaluation since 1934. Tyler's career is traced from his doctoral studies at the University of Chicago to his guidelines for national assessment. (LMO)

These proceedings include four papers on the status of evaluation Michael Scriven ("Evaluation: The State of the Science") examines the general picture of evaluation, identifies a number of trends in the field, and presents several new evaluation concepts. Included are discussions of "responsibility evaluation,""value…

This speech concerns the dimensions of context-oriented evaluation and begins with a discussion of the differences between measurement, research, statistical methodology, and evaluation. Decision-oriented evaluation is described as a process in which the evaluator has, as a major concern, the responsibility to determine likely decisions prior to…

The Department of Measurement, Statistics, and Evaluation (EDMS) at the University of Maryland is working to develop Master's degree programs that are oriented around developing assessment professionals for work in applied settings. Two fundamentally different sets of experiences are being developed: (1) assessment development, administration, and…