In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

In this article we report on the results of a pilot study on the use of task-based multilingual and multicultural professional scenarios for higher education teachers and learners at BA and MA level. The scenarios reflect new learning outcomes and assessment criteria for the presently under-conceptualised domain of communication in multilingual…

This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…

The quality of e-learning can be defined in many different ways, reflecting different stakeholders and the complexity of the systems and processes used in higher education. These different conceptions of quality can be mutually contradictory and, while politically significant, may also be beyond the direct control or influence of institutional…

The purpose of this paper is to bring to light elements that teachers require in order for learning gained during professional development sessions to find a place in their classroom practices and to affect student learning. Through their inquiry with K-12 educators at the Margaret Sue Copenhaver Institute for Teaching and Learning, a professional…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

This paper describes a model proven to be effective for assessing and documenting evidence of student learning outcomes. Specifically, it will share a model, F.A.M.O.U.S. Copyright ©2008, which is an acronym exemplifying six effective steps for complying with institutional accountability and eternal assessment requirements proscribed by the…

This handbook is primarily for the Teacher Education Accreditation Council (TEAC) auditor. It is intended to help in preparing for audits of "Inquiry Briefs" and "Inquiry Brief Proposals" and to contribute to the writing of the audit report. This handbook contains a full description of the audit process, the responsibilities of…

The Teacher Education Accreditation Council's (TEAC's) "Guide to Accreditation" is primarily for the faculty, staff, and administrators of TEAC member programs. It is designed for use in preparing for both initial and continuing accreditation. Program personnel should understand and accept all the components of the TEAC accreditation process…

School and district leaders are commonly faced with diverse student needs and interests that could be effectively addressed with a course that is not currently offered in local schools. Virtual schools have grown up over the past 15 years in different policy and budget ecosystems, but most online course programs can be classified in one of six…

National Board Certification is administered by the National Board for Professional Teaching Standards, to advance the quality of teaching and learning by developing professional standards for accomplished teaching, creating a voluntary system to certify teachers who meet those standards and integrating certified teachers into educational reform…

The Teacher Education Accreditation Council (TEAC) "Guide to Accreditation" includes a full description of TEAC's principles and standards, the accreditation process and audit, and detailed instruction on writing the "Brief." This revision includes expanded information on (1) preparing an "Inquiry Brief Proposal" and the audit of the "Inquiry…

As public and private funders have focused on evaluating the effectiveness of workforce development programs, a myriad of data collection systems and reporting processes have taken shape. Navigating these systems takes significant time and energy and often saps frontline providers' capacity to use data internally for program improvement.…

Oregon State University (OSU) is located in Corvallis, a community of 53,000 people situated in the heart of the Willamette Valley between Portland and Eugene. Approximately 15,700 undergraduate and 3,400 graduate students, including 2,600 U.S. students of color and 950 international students, are currently enrolled at OSU across 11 academic…

Paradise Valley Community College (PVCC), located in Phoenix, Arizona, is part of the Maricopa County Community College District (MCCCD). PVCC was founded in 1987 and in the fall of 2007 served 8,739 students in credit courses. Since 1997, PVCC has been on a quest to become a "more learning centered" college. As a result of placing…