Purpose: This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education. Design/methodology/approach: The application was developed using a design-based research (DBR) methodology. The application's design was…

High-stakes, standardized testing plays an important role in the lives of many students as they apply to college and compete for scholarships. In states where college readiness measures, like the ACT® test, are used for school and district accountability, the ACT scores of all students, whether college-bound or not, are a top priority for school…

Many scales contain both positively and negatively worded items. Reverse recoding of negatively worded items might not be enough for them to function as positively worded items do. In this study, we commented on the drawbacks of existing approaches to wording effect in mixed-format scales and used bi-factor item response theory (IRT) models to…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This article provides an introduction to the kind of computer software that is used to score student writing in some high stakes testing programs, and that is being promoted as a teaching and learning tool to schools. It sketches the state of play with machines for the scoring of writing, and describes how these machines work and what they do.…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

The Microcomputer Diagnostic Testing Project (MDTP) was designed to broaden the use of microcomputers in student testing, for elementary and secondary school use, and for a variety of test item formats. MDTP was designed to administer tests, to allow teachers to create or revise tests, to print out test forms when desired, to score tests, to…

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…

This manual is intended to provide Illinois school districts with guidance in developing learning assessment plans and using testing materials as part of the school improvement program mandated by the 1985 educational reform legislation for Illinois. Designed primarily to be a series of "how to" booklets, the manual is divided into six…

A teacher's manual for operating the DX System, a software package for use in diagnostic testing programs, is presented. The DX System is constructed to present test items based on the individual student's pattern of responses. Described are: (1) system components designed to run on an Apple II computer; (2) program options allowing the user to…

This handbook is intended for persons who might develop or use an item bank to support their testing program. An item bank is defined as a "large collection of distinguishable test items," with "large" explained as meaning that the number of items available is greater than the number to be used in any one test. The first section of the handbook…

National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)

The Maryland Functional Testing Program (MFTP) uses the Rasch model as the statistical framework for the analysis of test items and scores. This paper is designed to assist the reader in developing an understanding of the fit statistics in the Rasch model. Background materials on application of the Rasch model in statistical analysis of the MFTP…

"Harvard Education Letter" is published bimonthly at the Harvard Graduate School of Education. This issue of "Harvard Education Letter" contains the following articles: (1) Testing Goes to Preschool: Will State and Federal Testing Programs Advance the Goal of School Readiness for All Children? (Robert Rothman); (2)…