Time limits on some computer-adaptive tests (CATs) are such that many examinees have difficulty finishing, and some examinees may be administered tests with more time-consuming items than others. Results from over 100,000 examinees suggested that about half of the examinees must guess on the final six questions of the analytical section of the…

This paper reviews the role of ICT-based assessment in the light of the growing use of virtual learning environments in universities. Issues of validity, efficiency, type of response, and scoring are addressed. A major area of research is the automated scoring of text. Claims for automated formative assessment are queried, since the feedback of…

In this study, 5,257employees provided upward feedback ratings for 759 target managers who had the option of having their subordinates rate them using a traditional paper-and-pencil (opscan) response mode or using the company's intranet. Preliminary analyses showed mean online ratings were more favorable than were mean paper-and-pencil ratings (d…

The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models…

The role of pupil assessment in ICT is often seen by teachers as problematic. This article will explore the relationship of the two and will argue that research in assessment has not kept up with the opportunities offered by ICT. Conversely, some of the new developments in "assessment for learning" have not yet found their way into ICT.…

Eighty-three Test of English as a Foreign Language (TOEFL) writing prompts administered via computer-based testing between July 1998 and August 2000 were examined for differences attributable to the response mode (handwriting or word processing) chosen by examinees. Differences were examined statistically using polytomous logistic regression. A…

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

Because technology is more prevalent and accessible for use in assessment, this article highlights what counselors and educators need to know when considering the use of computers and the Internet for that purpose. The article concludes with some predictions on how technology might influence assessment and accountability in the future. This…

With the growing demand for and use of computer-based language tests (CBLTs) comes the need for clear guidelines to help educators as they attempt to select appropriate tests to assess their students with respect to their second- and foreign-language (L2/FL) teaching-learning goals. The purpose of this article is to provide guidelines to educators…

With the introduction of online course surveys comes the related issue of reporting survey results. This article is based on the experiences of Georgia Institute of Technology in Atlanta (Georgia Tech), a large, Doctoral/Research-Extensive institution where all end-of-term course surveys have been online since the fall semester of 1999. This…

The purpose of the study was to determine comparability of an online version to the original paper-pencil version of Defining Issues Test 2 (DIT2). This study employed methods from both Classical Test Theory (CTT) and Item Response Theory (IRT). Findings from CTT analyses supported the reliability and discriminant validity of both versions.…

HIV-related behaviors, self-reported using Web-delivered or paper-pencil modes, were collected from two convenience samples of college students at a major university in the southeastern U.S. To enhance the equivalence of the comparisons, a subset pool of participants from each group, proportionally matched on key demographic variables including…

Background: This study assessed whether data-collection formats, computerized versus paper-and-pencil, affect response patterns and descriptive statistics for adolescent health assessment surveys. Youth were assessed as part of a health risk reduction program. Methods: Baseline data from 1131 youth were analyzed. Participants completed the…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

This article discusses a study which was designed to explore how online scaffolding can be incorporated to support knowledge acquisition in asynchronous discussion. A group of Singapore preservice teachers engaged in collaborative critiquing of videos before they embarked on their video projects to illustrate what constitutes good and bad video…