Many large-scale testing programs routinely pretest new items alongside operational (or scored) items to determine their empirical characteristics. If these pretest items pass certain statistical criteria, they are placed into an operational item pool; otherwise they are edited and re-pretested or simply discarded. In these situations, reliable…

This report documents progress at the Center for Research on Evaluation, Standards, and Student Testing (CRESST) on the feasibility of scoring concept maps using technology. CRESST, in its integrated simulation approach to assessment, has assembled a suite of performance assessment tasks (the integrated simulation) onto which they have mapped the…

A conception of discussing mathematical material in the domain of calculus is outlined. Applications include that university students work at their knowledge and prepare for their oral examinations by utilizing the dialog system. The conception is based upon three pillars. One central pillar is a knowledge base containing the collections of…

This study explored the effect of item exposure on two conventional examinations administered as computer-based tests. A principal hypothesis was that item exposure would have little or no effect on average difficulty of the items over the course of an administrative cycle. This hypothesis was tested by exploring conventional item statistics and…

Recently, the Test of English as a Foreign Language (TOEFL) changed by including a writing section that gives the examinee an option between computer and handwritten formats to compose their responses. Unfortunately, this may introduce several potential sources of error that might reduce the reliability and validity of the scores. The seriousness…

Recently, the Test of English as a Foreign Language (TOEFL) changed by including a direct writing assessment where examinees choose between computer and handwritten composition formats. Unfortunately, examinees may have differential access to and comfort with computers; as a result, scores across these formats may not be comparable. Analysis of…

A constrained computerized adaptive testing (CAT) algorithm is presented that automatically equates the number-correct scores on adaptive tests. The algorithm can be used to equate number-correct scores across different administrations of the same adaptive test as well as to an external reference test. The constraints are derived from a set of…

This paper shows how JavaScript can be used within HTML pages to add interactive review sessions and quizzes incorporating graphics and sound files. JavaScript has the advantage of providing basic interactive functions without the use of separate software applications and players. Because it can be part of a standard HTML page, it is…

Describes some recent developments in computer programing taking place in Australia in the field of educational testing. Topics discussed include item banking and computer-assembled tests, test scoring for multiple choice and open-ended tests, item and test analysis, and test reporting. (Author/DN)

Reports on the development of a computer program that was used with five different readability formulas to assess levels of reading difficulty. (FL)

Three experiments examined whether the phenomena of visual search for single characters (Sternberg, 1966) generalizes to word and word-category search when target and distractor sets had varied and consistent mappings across trials. Previous results were replicated. Four principles of search are discussed within a theory of automatic/control…

To assess the feasibility of computer-assisted Federal Aviation Administration certification examinations, a system for administering the Private Pilot Certification Examination was implemented using PLATO. Characteristics, reactions, and guidelines for use of the test are included. (Author/JJD)

Compares two methods for computer generation of tests: question retrieval and question generation. Both techniques are described with specific applications for university teaching. Also evaluates the effects of these methods on student performance. Future developments of computer assisted test construction are also discussed. (CS)

This article describes how one commercially available system, the Classroom Teacher Support System (CTSS), has been adapted to an individualized nursing program for computer assisted testing. (RAO)

A professor of physical chemistry sees a sharp decline in math competence among his students and feels the reason is poor testing. How this can be changed is outlined, including a proposal to examine by computer. (Author/MSE)