Mounting concerns about the levels and distributions of human capital, as well as how they are associated with outcomes for individuals and societies, have contributed to an increase in the number of national and international surveys. These surveys not only examine skills among school-age and adult populations, they also facilitate evaluation of…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

The current study detailed the manner in which one school district monitored the effectiveness of the Wilson Reading System for students with disabilities who were experiencing difficulty with reading. Effectiveness was measured by growth in the reading skills that have been documented to be critical for successful readers. Twenty fourth- and…

Schools and districts should use a well-designed needs assessment to inform important decisions about a range of technology program areas. Presently, there is a lack of valid and reliable instruments available and accessible to schools to effectively assess their educational needs to better design and evaluate their projects and initiatives. The…

The purpose of this study was to assess staff and client perspectives on the Internet-based Journey Mapping program evaluation tool. A drug court program was chosen for a case study research design. Six staff and 10 clients participated in interviews and observations, and also responded to a questionnaire. A staff survey provided additional data.…

The Accelerated Reader program from Renaissance Learning Inc. is a popular program implemented in elementary and middle schools across the country that encourages students to read and monitors their progress in the program. Despite its widespread use and popularity, there have been some questions about the program's effectiveness at increasing…

There are three purposes for evaluation: evaluation for action to aid the decision making process, evaluation for understanding to further enhance enlightenment and evaluation for control to ensure compliance to standards. This article argues that the primary function of evaluation in the "Catherine Wheel" computer-based assessment (CBA)…

This article reports on the e-Framework Reference Model for Assessment (FREMA) project that aimed at creating a reference model for the assessment domain: a guide to what resources (standards, projects, people, organisations, software, services and use cases) exist for the domain, aimed at helping strategists understand the state of e-learning…

Educators have long debated the usefulness (or otherwise) of final examinations; a debate that has typically revolved around the relative merits of closed-book exams, open-book exams, take-home exams or their substitution by some other assessment format (e.g., project work). This paper adds a new dimension to the debate by considering how the…

This session will describe the social validity, usability and intent to use of an interactive, state-of-the-art, professional development program based on the Response to Intervention (RtI) approach and its core components (e.g., problem-solving strategy; three tiers of intervention service delivery with universal, selected and intensive…

Describes tailored testing (in which a computer selects appropriate items from an item bank while an examinee is taking a test) and shows it to be superior to paper-and-pencil tests in such areas as reliability, security, and appropriateness of items. (IRT)

Purpose: The purpose of this paper is to describe how and why Texas A&M University at Qatar (TAMUQ) has developed a system aiming to effectively place students in freshman and developmental English programs. The placement system includes: triangulating data from external test scores, with scores from a panel-marked hand-written essay (HWE),…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

This study explored the impact of performance assessment versus traditional paper-and-pencil assessment on graduate students' achievement and motivation to learn while enrolled in a 16-lesson course on program evaluation methods. Students in two sections of the course were exposed to the same content and instructional methods, with one exception:…

Item banks and computer-generated tests in a Canadian community college's computerized testing system were evaluated and student and faculty attitudes surveyed. Item banks were found inadequate, tests addressed low-level learning outcomes, and the system's location in centralized administration gave instructional staff little ownership or…