Two methods for estimating the reliability of a computerized adaptive test (CAT) without using item response theory are presented. The data consist of CAT and paper-and-pencil scores from identical or equivalent samples, and scores for all examinees on one or more covariates, using the Armed Services Vocational Aptitude Battery. (TJH)

Item-writing considerations in creating instruments using Likert-type scales, according to Michael Busch, include semantics of labeling response choices and number of response categories. Jean Turner discusses problems regarding the use of Likert-scale questionnaires for L2 research, for instance the cultural background of language learners being…

The EA:es index (part of the Comprehensive Rorschach System) is discussed, demonstrating how conceptual difficulties and abstract jargon can result in misleading and contradictory inferences. The comments of J. E. Exner, Jr., and the response of J. H. Kleiger concern the importance of theory in Rorschach interpretation. (SLD)

Administered 12 psychological and 7 neurobehavioral performance tests twice to nonclinical normative samples of 30 adults (computer format only) and 30 adults (computer and conventional administration) with one week between administrations. Results suggest that individual test-retest reliability is not affected when tests are administered as part…

Discusses the factors affecting the decision to use computerized adaptive testing in a nursing certification examination. (SLD)

Studied the effects of answer review on results of a computerized adaptive test, the laboratory professional examination of the American Society of Clinical Pathologists. Results from 29,293 candidates show that candidates who changed answers were more likely to improve their scores. (SLD)

Discusses the issues surrounding the right to use psychological tests. Examines the American Psychological Association's efforts to restrict test access, the likely impact of restricting use, and the mission of the Fair Access Coalition on Testing, which is devoted to allowing all appropriately trained professionals access to such tests. (RJM)

Explored, using simulations, the use of disclosed items on continuous testing conditions under a worse-case scenario that assumes that disclosed items are always answered correctly. Some item pool and test designs were identified in which the use of disclosed items produces effects on test scores that may be viewed as negligible. (Author/MAK)

Describes and evaluates a "controlled assessment procedure" as a holistic approach to avoiding problems of administering and evaluating traditional exams. Key characteristics include: the question is known well in advance and is broad and open-ended, students are encouraged to respond in any self-selected written format, and the rationale and…

Addresses the issue of using computers in educational and psychological assessment. Results support the comparability of scores yielded by computerized and paper-and-pencil versions of the third edition of the Self-Description Questionnaire and respondents' preferences for computerized assessment. (Contains 47 references and 3 tables.) (Author/GCP)

The 1999 Standards for Educational and Psychological Testing eliminated concepts of content, criterion-related, and construct validity, instead focusing on evidence based on test content, response processes, internal structure, relations to other variables, and consequences of testing. Questions remain about amount of evidence needed,…

Performed a simulation study to demonstrate the dramatic impact of capitalization on estimation errors on ability estimation in adaptive testing. Discusses four different strategies to minimize the likelihood of capitalization in computerized adaptive testing. (SLD)

Proposes a new multistage adaptive-testing procedure that factors the discrimination parameter (alpha) into the item-selection process. Simulation studies indicate that the new strategy results in tests that are well-balanced, with respect to item exposure, and efficient. (SLD)

This investigation examined the effect of an extended time testing accommodation on the performance of students with disabilities, students educationally at risk in math, and students without disabilities. Ninety-seven eighth-grade students completed two equivalent forms of a standardized mathematics test, each under different testing conditions…

Several techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting…