Identifies a number of practical decisions that must be made when designing and developing criterion referenced tests as part of a larger system of computer assisted instruction. The topics discussed include test construction, test security, item presentation, and response capturing and scoring. (19 references) (CLB)

Test Pac, a test scoring and analysis computer program for moderate-sized sample designs using dichotomous response items, performs comprehensive item analyses and multiple reliability estimates. It also performs single-facet generalizability analysis of variance, single-parameter item response theory analyses, test score reporting, and computer…

Evaluates one of the first operational computerized-adaptive English-as-a-second-language tests in the United States, showing an overwhelmingly positive student reaction to the tests and higher effectiveness than conventional paper-and-pencil tests. (Author/CB)

This study adapted the Hidden Figures Test for use on PLATO and determined the reliability of the computerized version compared to the paper and pencil version. Results indicate the test was successfully adapted with some modifications, and it was judged reliable although it may be measuring additional constructs. (MBR)

Though the most widely used "Intelligence" tests have changed little in the last half century, the author predicts a variety of new influences of future intelligence testing, ranging from the ways we conceptualize intelligence, to the manner in which we pose problems to assess it. (Author/JAZ)

The goal of this program was to evaluate health care students' skills in data collection, diagnosis, and management of illness through computerized patient management simulations. Methodology of case management simulations and a sample case are provided. (SK)

Presents recommendations for improved testing practices in science based on an examination of contemporary assessment literature and interviews with educators. The recommendations address test format, teacher involvement in all steps of the testing process, and use of sampling strategies and computer technology. (MBR)

Twelve structural models of similarity were fitted to data from conventional and computer adaptive test (CAT) batteries measuring the same aptitude in a double cross-validation design. Three of the 12 models, including a multiplicative structure model, performed well, providing support for using CATs as replacements for conventional tests. (NSF)

Argues that, while computers make the computation of readability formulas easy, teachers should not forget the need to apply judgment and common sense to the results. Discusses RIXRATE, a computerized version of the Rix index and compares its performance to that of the Rauding Scale. (FL)

Explores the potential for using computers in the diagnosis of learning disabilities. Describes a prototype computer based system designed to assist teachers in the assessment of reading difficulties. (FL)

This paper presents a multistage adaptive testing test development paradigm that promises to handle content balancing and other test development needs, psychometric reliability concerns, and item exposure. The bundled multistage adaptive testing (BMAT) framework is a modification of the computer-adaptive sequential testing framework introduced by…

This study examined the time different ability level examinees spend taking a CAT on demanding items to these examinees. It was also found that high able examinees spend more time on the pretest items, which are not tailored to the examinees' ability level, than do lower ability examinees. Higher able examinees showed persistence with test…

When low-stakes assessments are administered to examinees, the degree to which examinees give their best effort is often unclear, complicating the validity and interpretation of the resulting test scores. This study introduces a new method for measuring examinee test-taking effort on computer-based test items based on item response time. This…

The purpose of this project was to develop valid evaluation procedures for the selection of Container Equipment Operators (CEOs) in the shipping industry. A job analysis was conducted to identify the essential tasks of the CEO job. Site visits, a task inventory, and the determination of essential tasks were used in the job analysis. The skills and…

One challenge associated with computerized adaptive testing (CAT) is the maintenance of test and item security while allowing for daily testing. An alternative to continually creating new pools containing an independent set of items would be to consider each CAT pool as a sample of items from a larger collection (referred to as a VAT) rather than…