Purpose: This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education. Design/methodology/approach: The application was developed using a design-based research (DBR) methodology. The application's design was…

High-stakes, standardized testing plays an important role in the lives of many students as they apply to college and compete for scholarships. In states where college readiness measures, like the ACT® test, are used for school and district accountability, the ACT scores of all students, whether college-bound or not, are a top priority for school…

Many scales contain both positively and negatively worded items. Reverse recoding of negatively worded items might not be enough for them to function as positively worded items do. In this study, we commented on the drawbacks of existing approaches to wording effect in mixed-format scales and used bi-factor item response theory (IRT) models to…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This article provides an introduction to the kind of computer software that is used to score student writing in some high stakes testing programs, and that is being promoted as a teaching and learning tool to schools. It sketches the state of play with machines for the scoring of writing, and describes how these machines work and what they do.…

The use of PLATO (registered) elementary school software in Fairview Elementary School, Dayton, Ohio, was studied. PLATO software had been used in Title I mathematics classes for the last 3 years. The Title I teacher used PLATO software as an integral part of her class instructional strategy. Mathematics achievement data were analyzed for 88 Title…

We evaluated computerized training and testing programs with children who were having difficulties learning prereading skills. The programs were derived from equivalence research and were written in authoring software designed for educators. After learning to match uppercase and lowercase printed letters to the corresponding letter names (Tasks 1…

An evaluation was conducted of student use of the PLATO computer assisted instruction system in the Highland Park Independent School District, Amarillo, Texas, a school district that has one elementary school, one middle school, and one high school. The evaluation was based on telephone interviews with the Assistant Superintendent, three written…

National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

The Maryland Functional Testing Program (MFTP) uses the Rasch model as the statistical framework for the analysis of test items and scores. This paper is designed to assist the reader in developing an understanding of the fit statistics in the Rasch model. Background materials on application of the Rasch model in statistical analysis of the MFTP…

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

Terry High School is one of three schools in the Lamar Consolidated Independent School District, Texas, serving students in grades 9 through 12. Because of low student achievement on the Texas Assessment of Academic Skills (TAAS), the faculty and administration selected PLATO Learning, Inc. computer assisted instruction programs as the primary…

New Hampshire has adopted a standards-based statewide assessment, the New Hampshire Educational Improvement and Assessment Program (NHEIAP), which is designed to measure students' learning against proficiency standards at grades 3, 6, and 10. Because of the difficulty teachers had in interpreting the NHEIAP results, a custom-designed software…

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…