A new procedure, the Letter Memory Test, was developed for evaluating adequacy of effort given during neuropsychological testing. It is a computer-administered forced-choice recognition task. In three studies involving nearly 400 patients and community volunteers, the test discriminated among poorly and highly motivated groups, and its internal…

Proposes an algorithm that minimizes the asymptotic variance of the maximum-likelihood (ML) estimator of a linear combination of abilities of interest. The criterion results in a closed-form expression that is easy to evaluate. Also shows how the algorithm can be modified if the interest is in a test with a "simple ability structure."…

The extent to which variables from a previous study (P. Mosenthal, 1996) on document processing influenced difficulty on 165 tasks from the pose scales of five national adult literacy scales was studied. Three process variables accounted for 78% of the variance when prose task difficulty was defined using level scores. Implications for computer…

Discusses computerized dynamic testing with cues and items presented according to objective algorithms, elaborating on appropriate designs and psychometric models. Presents two studies involving 311 military recruits and 584 recruits that support the psychometric properties of a test measuring the susceptibility of reasoning to stressors. (SLD)

The International Test Commission's (this issue) Guidelines on Computer-Based and Internet-Delivered Testing constitute a comprehensive and excellent set of internationally agreed guidelines. This article looks forward and discusses what should be done to ensure that these guidelines will be used in educational, clinical, and organizational…

The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

This article provides a broad overview of the definition of web-based surveys examining some of the benefits and burdens related to using the Web for data collection. It draws upon the experience of two years of data collection on 10 university campuses demonstrating that there are noticeable differences in the speed with which web-based surveys…

The average Kullback-Keibler (K-L) information index (H. Chang and Z. Ying, in press) is a newly proposed statistic in Computerized Adaptive Testing (CAT) item selection based on the global information function. The objectives of this study were to improve understanding of the K-L index with various parameters and to compare the performance of the…

When items are selected during a computerized adaptive test (CAT) solely with regard to their measurement properties, it is commonly found that certain items are administered to nearly every examinee, and that a small number of the available items will account for a large proportion of the item administrations. This presents a clear security risk…

The purpose of many certification or licensure tests is to identify candidates who possess some level of minimum competence to practice their profession. In general, this type of test is referred to as classification testing. When this type of test is administered with a computer, the test is a computerized classification test (CCT). This paper…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

Nine methods for automated test construction are described. All are based on the concepts of information from item response theory. Two general kinds of methods for the construction of parallel tests are presented: (1) sequential test design; and (2) simultaneous test design. Sequential design implies that the tests are constructed one after the…

This procedure for testing the mastery of programming skills uses online testing and correction. The student is presented with a test problem and is asked to solve it, encode the solution, debug the code, and save it on a floppy disk. The instructor corrects the program at the appropriate points through the use of REM statements. The erroneous or…

This paper describes an interactive computer software system developed at Tuskegee Institute which is designed to allow flexibility in the development, administration, and scoring of examinations. (Author)

Compares test-generating programs which accompany six different college-level history textbooks. Points out the basic features and usefulness of each. The test-generating programs reviewed are the Norton Testing System, Brownstone Research Group, two versions of Microtest, Floppy Disk Test Item Files, and Computest Microcomputer Testing System.…