Computerized testing has created new challenges for the production and administration of test forms. This paper describes a multi-stage, testlet-based framework for test design, assembly, and administration called computer-adaptive sequential testing (CAST). CAST is a structured testing approach that is amenable to both adaptive and mastery…

Developed a method based on 0-1 linear programming to stratify an item pool optimally for use in alpha-stratified adaptive testing. Applied the method to a previous item pool from the computerized adaptive test of the Graduate Record Examinations. Results show the new method performs well in practical situations. (SLD)

Concerns about Internet-based career assessments include the following: users' technical skill level, lack of screening, psychological factors, cultural bias, unprotected results, technical failures, lack of standardization, digital divide, interpretation problems, outdated tests, copyright violations, administrator qualifications, and hidden…

The use of computer-based test interpretation (CBTI) in career assessment raises numerous ethical and professional issues: How do current standards apply to Internet tests? What are appropriate and inappropriate uses of CBTI? How can it be used in career counseling? Who is qualified to use CBTI? and What are the potential benefits and problems?…

Several classical approaches and alternative approaches to item selection for computerized adaptive testing (CAT) are reviewed and compared. The study also describes procedures for constrained CAT that may be added to classical item selection approaches to allow them to be used for applied testing. (TJH)

Discusses computerized testing and certification and proposes three levels of certification testing, each one corresponding to a different notion of competent performance, from basic knowledge to expert performance. Declarative and procedural knowledge are defined; performance-based tests are discussed; and testing for problem-solving ability is…

Discusses problems of diagnosing and repairing infeasible linear-programming models in computerized test assembly. Demonstrates that it is possible to localize the causes of infeasibility, although this is not always easy. (SLD)

Responds to an article on computerized adaptive second language (L2) testing, expressing concerns about the appropriateness of such tests for informing language educators about the language skills of L2 learners and users and fulfilling the intended purposes and achieving the desired consequences of language test use.The authors of the original…

Suggests that because of the nonlinear relationship between item usage and item security, the problems of test security posed by continuous administration of standardized tests cannot be resolved merely by increasing the size of the item pool. Offers alternative strategies to overcome these problems, distributing test items so as to avoid the…

Reviewed methods of estimating theta suitable for computerized adaptive testing (CAT) and discussed the differences between Fisher and Kullback-Leibler information criteria for selecting items. Examined the accuracy of different CAT algorithms using samples from the National Assessment of Educational Progress. Results show when correcting for…

Proposed a refinement, based on the stratification of items developed by D. Weiss (1973), of the computerized adaptive testing item selection procedure of H. Chang and Z. Ying (1999). Simulation studies using an item bank from the Graduate Record Examination show the benefits of the new procedure. (SLD)

Discusses the potential positive and negative effects computer-based testing could have on validity, reviews the literature on validation perspectives in computer-based testing, and suggests ways to evaluate the contributions of computer-based testing to more valid measurement practices. (SLD)

This study examined the utility of Web-based quizzing. We assigned 3 classes to a no-quiz, in-class quiz, or Web-based quiz condition. Midsemester results demonstrated a positive effect for in-class quizzing but not Web-based quizzing. After several adjustments in quiz presentation and duration, the Web-based group increased exam performance to a…

In addition to its precision superiority over nonadaptive tests, another known advantage of computerized adaptive tests (CATs) is that they can be offered on a continuous basis. This is advantageous to examinees in terms of flexibility of test scheduling, as well as advantageous to schools and other testing centers in terms of both space and…

Researchers at Emory University and the University of North Carolina at Chapel Hill are seeking an answer to whether the Internet can help save the life of a suicidal student. A study conducted at both colleges gauged the effectiveness of anonymous online depression-screening questionnaires and results indicate that the surveys helped counselors…