Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

Possible causes of a 16-point mean score increase for the computer adaptive form of the College Level Academic Skills Test (CLAST) in reading over the paper-and-pencil test (PPT) in reading are examined. The adaptive form of the CLAST was used in a state-wide field test in which reading, writing, and computation scores for approximately 1,000…

Recent experience with the Computerized Adaptive Test (CAT) has raised a number of concerns about its practical applications. The concerns are principally involved with the concept of having the computer construct the test from a precalibrated item pool, and substituting statistical characteristics for the test developer's skills. Problems with…

One question regarding the utility of adaptive testing is the effect of individualized item arrangements on examinee test scores. The purpose of this study was to analyze the item difficulty choices by examinees as a function of previous item performance. The examination was a 25-item test of basic algebra skills given to 36 students in an…

Contains an annotated bibliography of articles which deal with computer-assisted testing. Includes the author's name, the periodical in which the article appeared, and a short description of the article. (TW)

In 2005, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) conducted an assessment of Year 6 and Year 10 students across Australia to assess their proficiency in ICT literacy. The 2005 ICT literacy assessment instrument consisted of seven discrete thematic modules. One module, the General Skills Test, included…

The Microcomputer Diagnostic Testing Project (MDTP) was designed to broaden the use of microcomputers in student testing, for elementary and secondary school use, and for a variety of test item formats. MDTP was designed to administer tests, to allow teachers to create or revise tests, to print out test forms when desired, to score tests, to…

Test scores were compared for two types of objective achievement tests--multiple choice tests and the recently developed Multi-Digit Test (MDT) procedure. MDT is an approximation of the fill-in-the-blank technique. Students select their answers from long lists of alphabetized terms, with each answer corresponding to a number from 001 to 999. The…

Reviews study conducted to compare levels of achievement on final exams for college students responding to combinations of test-item feedback methods and modes of test-item presentation. The PHOENIX computer system used in the comparison is described, and the use of ACT (American College Testing Program) scores for ability comparison is discussed.…

The purpose of this study was to determine the measurement comparability of paper-and-pencil and multimedia versions of two career assessment components in the DISCOVER multimedia career and education planning system. Students in grade 9 (N=606) and 11 (N=416) completed paper-and-pencil and Compact Disc-interactive (CD-i) versions of the Unisex…

This review of research on assessment of second-language listening abilities looks at some testing issues and challenges (assessing higher-level skills, confounding of skills, assessing listening in oral interaction, authenticity), discusses assessment methods and techniques (test administration, item formats), and considers potential applications…

This paper describes an English language listening test intended as computer-based testing material for secondary school students in Hong Kong, where considerable attention is being invested in online and computer-based testing. As well as providing a school-based testing facility, the study aims to contribute to the knowledge base regarding the…

The transition from paper-based to computer-based assessment raises a number of important issues about how mode might affect children's performance and question answering strategies. In this project 104 eleven-year-olds were given two sets of matched mathematics questions, one set on-line and the other on paper. Facility values were analyzed to…

This paper reports the results of a study of the development of an innovative learning element designed to be implemented in a computer-facilitated learning (CFL) module. The learning element is an open-ended, short answer, text question tool (TQT) designed to be used in World Wide Web-based courses or incorporated into hybrid Web/CD-ROM systems.…

This report describes courseware for comprehensive computer-assisted testing and instruction. With this program, a personal computer can be used to: (1) generate multiple test versions to meet test objectives; (2) create study guides for self-directed learning; and (3) evaluate student and teacher performance. Numerous multiple-choice examples,…