This study compared several item exposure control procedures for computerized adaptive test (CAT) systems based on a three-parameter logistic testlet response theory model (X. Wang, E. Bradlow, and H. Wainer, 2002) and G. Masters' (1982) partial credit model using real data from the Verbal Reasoning section of the Medical College Admission Test.…

Computer-based testing places great burdens on all involved parties to ensure test security. A task analysis of test site security might identify the areas of protecting the test, protecting the data, and protecting the environment as essential issues in test security. Protecting the test involves transmission of the examinations, identifying the…

Presents an attempt at simplifying test-making procedures through use of a computer. The advantages of the system over conventional evaluation methods are discussed and an outline of its capabilities and limitations is provided. (BD)

Combined the methods of alpha-stratified adaptive testing and constrained adaptive testing with shadow tests. Outlines the advantages of this approach in reducing overexposure and underexposure of items in an item pool and illustrates these advantages with an example from the Law School Admission Test. (SLD)

Compared the properties of five methods of item exposure control in the context of estimating examinees' abilities in a computerized adaptive testing situation. Findings show advantages to the Stocking and Lewis conditional multinomial procedure (M. Stocking and C. Lewis, 1995) and, to a lesser degree, the Davy and Parshall method (T. Davey and C.…

Conducted a meta-analysis to determine the extent to which the computer administration of a measure influences socially desirable responding. Discusses implications of the findings about impression management in terms of how they contribute to the explication of the construct of social desirability and cross-mode equivalence. (Author/SLD)

Evaluated three strategies for assigning examinees to grading categories in computerized adaptive testing. The expected a posteriori-based method had more correct classifications in the middle range of grade levels and more errors for the extremes than the golden section search grading test and the Z-score grading test. (SLD)

This study addressed the following question: Does a computerized test with an auto-score feature enhance students' test performance of phonic content compared to an existing paper-and-pencil test? Students in two four-semester-credit courses (teaching reading in the elementary school) formed the two treatment groups. The results indicate that on…

One attempt to make scores from large-scale assessments more interpretable has been to provide proficiency level scores to describe the meaning of student performance on tests. This study has examined the accuracy of Ercikan and Julian's (2002) guidelines for developing proficiency level scores and the classification accuracy of proficiency level…

This paper describes a study of the computer essay-scoring program BETSY. While the use of computers in rating written scripts has been criticised in some quarters for lacking transparency or lack of fit with how human raters rate written scripts, a number of essay rating programs are available commercially, many of which claim to offer comparable…

Introductory gerontology courses have the potential to enhance student appreciation of aging issues. The effectiveness of such courses for informing views about individual aging is little studied. This study, using a quasi-experimental design, examines the impact of participation in an introductory course in aging on 158 undergraduate students in…

This study compared the impact of proctoring on the final course grades of community college students enrolled in distance education mathematics courses. The goal was to determine whether distance education students who are evaluated entirely online, in environments that are not proctored, receive grades that differ from distance education…

The uptake of CAA in UK higher education (HE) on a large scale lags behind the expectations of CAA specialists. A research project was undertaken with the aim of discovering and addressing the underlying reasons for this. The research was conducted according to Strauss and Corbin's (1998) prescription for grounded theory (GT) research. During…

In current psychological research, the analysis of data from computer-based assessments or experiments is often confined to accuracy scores. Response times, although being an important source of additional information, are either neglected or analyzed separately. In this article, a new model is developed that allows the simultaneous analysis of…

Computerized adaptive testing (CAT) has unsurpassable advantages over traditional testing. It has become the mainstream in large scale examinations in modern society. This paper gives a brief introduction to CAT including differences between traditional testing and CAT, the principles of CAT, psychometric theory and computer algorithms of CAT, the…