In low-stakes testing, the motivation levels of examinees are often a matter of concern to test givers because a lack of examinee effort represents a direct threat to the validity of the test data. This study investigated the use of response time to assess the amount of examinee effort received by individual test items. In 2 studies, it was found…

Across the U.S., a growing number of schools are turning to ePortfolio assessment technologies to help them monitor and evaluate student progress in a variety of disciplines--and to help them and their students do even more. Across the board, educators report that their ePortfolio efforts have revolutionized the learning process, and the…

It is not what is taught that has the most influence on students' study behaviour, but rather what is assessed. Computer-assisted assessment offers the possibility of widening the scope of the material that is assessed, without placing excessive burdens on either staff or students. This article describes a computer-assisted assessment scheme…

Curriculum-based measurement is a system for monitoring students' progress and formatively evaluating instruction backed by 25 years of validation research. Most of this research has been conducted in elementary schools. In middle and high school classrooms, where there is an emphasis on mastering content knowledge, elementary-level measurements…

This study examined the construct validity of the "e-rater"® automated essay scoring engine as an alternative to human scoring in the context of TOEFL® essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two "e-rater" scores were investigated in this study, the first…

Computer adaptive testing is the study of scoring tests and questions based on assumptions concerning the mathematical relationship between examinees' ability and the examinees' responses. Adaptive student tests, which are based on item response theory (IRT), have many advantages over conventional tests. We use the least square method, a…

A multiple choice test item is identified as flawed if it has no single best answer. In spite of extensive quality control procedures, the administration of flawed items to test-takers is inevitable. Common strategies for dealing with flawed items in conventional testing, grounded in the principle of fairness to test-takers, are reexamined in the…

Computer-assisted testing (CAT) in counseling and therapy is becoming increasingly common due to dramatic improvements in cost-effectiveness and increased counselor familiarity with computer applications. The assumption underlying the use of CAT is that the effectiveness of counseling is improved by allocating repetitive computational and…

The potential for computer adaptive testing (CAT) has been well documented. In order to improve the efficiency of this process, it may be possible to utilize a neural network, or more specifically, a back propagation neural network. The paper asserts that in order to accomplish this end, it must be shown that grouping examinees by ability as…

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely…

The possibility exists that some people might be at a disadvantage in registering their responses to a computerized test if mouse manipulation were complicated. This would be of particular concern if some groups were differentially affected by the complexity of manipulation. This study analyzed data from a pilot test conducted in 1991 for the…

Two-stage and multistage test designs provide a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and, based on their scores, they are routed to tests of different difficulty levels in subsequent stages. These designs provide some of the benefits of standard computerized adaptive testing…

This study was designed to test preschoolers' thinking about strategies and the relationship between strategy selection and performance through the use of computer-presented puzzle tasks. A total of 61 children between the ages of 3 and 5 years were observed to see whether they used trial and error, model consultation, or a mixed strategy to solve…

In computerized adaptive testing, updating parameter estimates using adaptive testing data is often called online calibration. In this paper, how to evaluate whether the adaptive testing model used for online calibration fits the item response model used sufficiently is studied. Three approaches are investigated, based on a Lagrange multiplier…