Dr. Tracey Burns is a Senior Analyst in the OECD's Centre for Educational Research and Innovation. She heads a portfolio of projects including Innovative Teaching for Effective Learning, 21st Century Children and Trends Shaping Education. Until recently she was also responsible for the OECD work on Governing Complex Education systems. Previous to…

Most, if not all, computerized adaptive testing (CAT) programs use simulation techniques to develop and evaluate CAT program administration and operations, but such simulation tools are rarely available to the public. Up to now, several software tools have been available to conduct CAT simulations for research purposes; however, these existing…

Computerized testing, including the widely used MAP test, has infiltrated the public schools in Milwaukee and across the nation, bringing with it a frightening future for public education. High-stakes standardized tests can be scored almost immediately via the internet, and testing companies can now easily link districts to their online data…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Computer-based testing places great burdens on all involved parties to ensure test security. A task analysis of test site security might identify the areas of protecting the test, protecting the data, and protecting the environment as essential issues in test security. Protecting the test involves transmission of the examinations, identifying the…

Discusses computerized testing and certification and proposes three levels of certification testing, each one corresponding to a different notion of competent performance, from basic knowledge to expert performance. Declarative and procedural knowledge are defined; performance-based tests are discussed; and testing for problem-solving ability is…

Describes what a Web-based language test (WBT) is, how WBTs differ from traditional computer-based tests, and what uses WBTs have in language testing. After a brief review of computer-based testing, WBTs are defined and categorized as low-tech or high tech. Advantages and design and implementation issues of WBTs are considered before examining the…

Discusses ways of designing software to minimize the problems associated with translating the users interface from English into a foreign language. The Examiner, a test development and delivery system that was translated from English into Dutch, is used as an example, and both its design and its implementation are described. (LRW)

Claims that human behavior derives specifically from areas of ungratified needs, so by observing behavior we have a projection of need presence. Describes the Cassel Computerized Biofeedback Need Gratification Assessment (NEEDS) which is designed to assess the degree of need presence within an individual; both for the conscious and unconscious…

This discussion of the use of microcomputer software in a medical school class for the purposes of emulating oral examinations begins by stating the three major goals of testing in medical school. The limitations of multiple choice tests and oral examinations are then discussed, and the use and suitability of computers to administer and to avoid…

Ten different methods of using computer administered tests in college level biology are described: evaluation (or posttest), student self-evaluation, student self-remediation, class remediation, individual student remediation, pretesting, identification of problem areas, immediate feedback, group testing, and remote site testing. (Author/MBR)

A professor of physical chemistry sees a sharp decline in math competence among his students and feels the reason is poor testing. How this can be changed is outlined, including a proposal to examine by computer. (Author/MSE)

The testlet, a bundle of test items, alleviates some problems associated with computerized adaptive testing: context effects, lack of robustness, and item difficulty ordering. While testlets may be linear or hierarchical, the most useful ones are four-level hierarchical units, containing 15 items and partitioning examinees into 16 classes. (GDC)

Describes capabilities of test and worksheet generator software; discusses features to consider when evaluating the software for purchase; and presents reviews of eight test and worksheet generators: P.D.Q., Testmaster, Easy Quiz Maker, EA Mathematics Worksheet Generator, Mathematics Worksheet Generator, Earth Science Test Maker, Individualized…

Describes measurement problems associated with computer based testing (CBT) programs when they are part of a computer assisted instruction curriculum. Topics discussed include CBT standards; selection of item types; the contamination of items that arise from test design strategies; and the non-equivalence of comparison groups in item analyses. (8…