Over the last 20 years, writing about technology (and more recently about its use in assessment systems) has been a joyful experience, in part because the author was usually right about how fast and how unexpected technology progress would be made. In this article, the author suggests to rethink assessment systems from design perspectives and the…

This article describes the translation goals, challenges, strategies, and solutions employed in the development of a computer-based, self administered, psychiatric diagnostic instrument, the Diagnostic Interview Schedule for the Deaf (D-DIS-IV) in American Sign Language (ASL) with English captions. The article analyzes the impact of the…

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…

This paper examines ways in which hardware and software technologies can be used for effective educational assessment. The analysis considers current uses of computer technology in educational assessment and future applications. Computer systems can integrate administration of measurement instruments, presentation of instructional materials,…

The microcomputer has increased interest in performance testing, which samples what a person can do rather than what he or she knows. Conventional psychometric theory is based on knowledge tests, but in performance testing the unit of analysis is a trial, and it is unreasonable to assume that mean performance and interim correlations are…

A conceptual framework is provided for generating assessment tasks that provide an instructor with a richer description of student reasoning/thinking than is possible by simply giving students problems to solve. The application of this framework is illustrated with material from introductory statistics courses which focus on: (1) sampling; (2)…

Methods are proposed for the construction of weakly parallel tests, that is, tests with the same test information function. A mathematical programing model for constructing tests with a prespecified test information function and a heuristic for assigning items to tests such that their information functions are equal play an important role in the…

For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…

A computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB) is being developed to test ten areas of vocational aptitude. Development of the CAT-ASVAB is based upon the use of item banks, testing and scoring procedures, assessment of test reliability and test validity, a technical manual, and the…

Some of the benefits available from using computers to administer the kinds of tests that are familiar in educational settings are reviewed. Four applications that represent current or near-term enhancements of assessment are discussed: computerized adaptive testing, diagnostic testing, test preparation, and administration of simulations of…

Recent increases in the speed and accessibility of computers and networks have made it possible to administer tests on-line. On-line assessment can be conducted in a controlled setting, such as a testing center, or distributed over local area networks or the Internet to libraries and student homes, allowing students the flexibility to complete…

Examines the effectiveness of an automated language proficiency test assembly system at an air force base English Language Center. The study focuses on the equivalence of mean score difficulty, total score variance, and intercorrelation covariance across test norms and finds a high level of test-form equivalence and internal consistency. (nine…

Discusses the research and steps needed to develop performance-based and computer-adaptive assessments that are culturally responsive. Supports the development of a new conceptual framework and more explicit guidelines for designing culturally responsive assessments. (SLD)

Examines the process of developing an English-as-a-Second-Language (ESL) cloze test by computer based on a language corpus. Two such tests developed and pilot-tested in Hong Kong were found to have test items that were not as good as they would have been if designed by a competent human, but better than expected. (Author/MSE)

This paper outlines an approach taken to produce computer-based formative assessments for two modules in a one-year taught MSc programme in Road Management and Engineering. It presents the aims of the assessments, the taxonomy adopted to ensure that the formulation of the questions addressed learning outcomes related to the development of higher…