In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Background: In 2008 primary education in England reached, historically, another important phase in its development. Government reviewed the primary curriculum and some aspects of the national system of assessment. These government reviews coincided with an independent "Primary Review" based at the University of Cambridge to which the…

One solution to the problem of obtaining test scores in order to assess multiple outcomes of educational programs is a basically simple technique called matrix sampling. Matrix sampling is the estimation of total test score statistics by administering random subsets of test items to randomly selected students. This chapter lays out the specific…

Although much has been written about educational evaluation, few guidelines exist for consumers--project directors, school administrators, curriculum developers, legislators, teachers, parents, and boards of education. Several cautions surface from a review of the literature. First, tests that are based on program objectives are most useful to…

In the final stages of drafting the 1974 revision of the Standards for Educational and Psychological Tests, it became clear to the committee members that the various drafts of the revisions emphasized the assessment of individuals, rather than program evaluation. Because of its concern, the committee decided to finish the present draft and to…

The experiences of state and local education agencies in implementing the RMC evaluation models in their evaluations of Elementary and Secondary Education Act Title I programs are discussed with emphasis on the problems encountered, suggestions for resolving these problems, and encouraging results which have been reported. Four activities are…

Part of a system by which local education agency (LEA) personnel may evaluate secondary and postsecondary vocational education programs, this sixth of eight components focuses on the evaluation of students' occupational competence based on the identification of job tasks. The component makes use of existing Vocational-Technical Education…

In eight chapters, this document offers guidelines for school administrators on evaluating schools and school programs, based on a poll of administrators and consultants. The introduction discusses the purpose of evaluation, especially school improvement, and presents a list of evaluation standards. Chapter 1 outlines steps in evaluation planning,…

Three years of cooperative effort by participating Illinois community colleges and the Ad Hoc Counseling Task Force resulted in the 1977 approval, by the Illinois Community College Board (ICCB), of a position paper on comprehensive counseling services and in the endorsement of guidelines in four student service areas. The ICCB supports counseling…

Part of a system by which local education agency (LEA) personnel may evaluate secondary and postsecondary vocational education programs, this third of eight components focuses on assessment of student career interests. Procedures covered include determination of the student population to be surveyed, selection of the instrument, and discrepancy…

A large central government providing numerous public services has long been a hallmark of Swedish society, which is also well-known for its pursuit of equality. Yet in the 1990s, Sweden moved away from this tradition in education, introducing market-oriented reforms that decentralized authority over public schools and encouraged competition…

This manual is intended for use in training new and first-year adult basic education (ABE) teachers in Kentucky. Discussed in the introductory chapter are the roots of ABE in Kentucky, the basic goals and objectives of ABE, and the ways in which programs are established and operated locally. Next, the characteristics of adult students are…