This paper describes the results of teacher education candidates' use of a Web-based assessment system including electronic portfolios. A teacher education program adopted a novel Web-based Accountability Model for assessment and learning. The Web-based Education Accountability System (EAS) was based on the Web-based Accountability Model, and…

This paper describes an English language listening test intended as computer-based testing material for secondary school students in Hong Kong, where considerable attention is being invested in online and computer-based testing. As well as providing a school-based testing facility, the study aims to contribute to the knowledge base regarding the…

The transition from paper-based to computer-based assessment raises a number of important issues about how mode might affect children's performance and question answering strategies. In this project 104 eleven-year-olds were given two sets of matched mathematics questions, one set on-line and the other on paper. Facility values were analyzed to…

This study aimed to comprehensively investigate the impact of a word-processor on an ESL writing assessment, covering comparison of inter-rater reliability, the quality of written products, the writing process across different testing occasions using different writing media, and students' perception of a computer-delivered test. Writing samples of…

The Delaware Department of Education (DDOE) was interested in evaluating components of a statewide pilot program to support instruction in World Languages (particularly Spanish and French). The first component was an online student assessment, the Standards-based Measurement of Proficiency (STAMP) to measure the learning outcomes. The DDOE also…

Providing detailed, constructive and helpful feedback is an important contribution to effective student learning. Quality assurance is also required to ensure consistency across all students and reduce error rates. However, with increasing workloads and student numbers these goals are becoming more difficult to achieve. An automated feedback…

Purpose: The purpose of this paper is to propose and demonstrate an evidence-based scenario design framework for assessment-based computer games. Design/methodology/approach: The evidence-based scenario design framework is presented and demonstrated by using BELLA, a new assessment-based gaming environment aimed at supporting student learning of…

This report describes the development of a new tool for assessment research in graduate education. The tool, the Algebra Assessment System, is based on GIDE, a pre-existing program that diagnostically analyzes complex constructed responses to algebra word problems. The project had three goals. The first goal was to build a generically usable…

This paper documents issues in converting the Figure Classification Test to the computer. The purpose of the test, which is almost entirely visual, is to determine the subject's ability to discover rules via the visual/spatial environment. The methodology of the paper-and-pencil Figure Classification Test is as follows: the subject views a series…

This paper studies whether examinee characteristics are systematically related to mode effect across paper and computer versions of the same instrument, using data from the Graduate Record Examination (GRE) of the Educational Testing Service in its Computer-Based Testing Pilot Study of 1991. The following characteristics of 1,114 examinees were…

The partial credit model of G. N. Masters (1982), a one-parameter unidimensional polychotomous Rasch model, was used to reduce the error of measurement, particularly for students near the cut score, and to permit measurement to reflect the actual ability of a student more accurately by reducing the degree of misfit for students near the cut…

This document consists of a curriculum guide combined with separately published "simulations" and "test bank" volumes designed to support instructors using the curriculum guide. The curriculum guide was developed to provide instructional materials to teachers of microcomputer application courses in Texas. The guide contains the…

This study examined scores from 133,906 operationally scored Test of English as a Foreign Language™ (TOEFL®) essays to determine whether the choice of composition medium has any impact on score quality for subgroups of test-takers. Results of analyses demonstrate that (a) scores assigned to word-processed essays are slightly more reliable than…

As a measure of musical aptitude, a new 90-item Pitch Discrimination Test was developed, and its internal structure was examined. Each of the three sections of the test measures an individual's aptitude for pitch discrimination in a different frequency range using square-wave tones generated by a personal computer. A total of 1,303 examinees,…

Three questions concerning the Binary Search Method (BSM) of computerized adaptive testing were studied: (1) whether it provided a reliable and valid estimation of examinee ability; (2) its effect on examinee attitudes toward computerized adaptive testing and conventional paper-and-pencil testing; and (3) the relationship between item response…