Four human judges agreed highly among themselves about the presence of errors committed by 60 adults solving algebra word problems, but were in less agreement about categorizing faults. An expert system agreed with judges about correctness of answers, but was in even less agreement about categorizing the faults. (SLD)

Details the advantages and process of creating an online English-as-a-Second-Language placement test. Outlines the steps for constructing a good test and describes the piloting of an online exam over a 2-year period. (Author/VWL)

Theory suggests that studying worked examples and engaging in self-explanation will improve learning and problem solving. A growing body of evidence supports the use of web-based assessments for improving undergraduate performance in traditional large enrollment courses. This article describes a study designed to investigate these techniques in a…

Computer-Based Assessment is a risky business. This paper proposes the use of a model for web-based assessment systems that identifies pedagogic, operational, technical (non web-based), web-based and financial risks. The strategies and procedures for risk elimination or reduction arise from risk analysis and management and are the means by which…

The current paper uses information obtained from teaching practices to conceptualize how computers might be used to enhance the supervision of graduate counselling students (herein called beginning counsellors). Using Hill and O'Grady's (1985) list of counsellor intentions, the author devised a computer program called "Counsellor Assisted…

This article reports the results of an investigation of the convergent criterion-related validity of two computer-based tools for scoring concept maps and essays as part of the ongoing formative evaluation of these tools. In pairs, participants researched a science topic online and created a concept map of the topic. Later, participants…

In recent years, there has been a large increase in the number of university applicants requesting special accommodations for university entrance exams. The Israeli National Institute for Testing and Evaluation (NITE) administers a Psychometric Entrance Test (comparable to the Scholastic Assessment Test in the United States) to assist universities…

Time limits on some computer-adaptive tests (CATs) are such that many examinees have difficulty finishing, and some examinees may be administered tests with more time-consuming items than others. Results from over 100,000 examinees suggested that about half of the examinees must guess on the final six questions of the analytical section of the…

This paper reviews the role of ICT-based assessment in the light of the growing use of virtual learning environments in universities. Issues of validity, efficiency, type of response, and scoring are addressed. A major area of research is the automated scoring of text. Claims for automated formative assessment are queried, since the feedback of…

In this study, 5,257employees provided upward feedback ratings for 759 target managers who had the option of having their subordinates rate them using a traditional paper-and-pencil (opscan) response mode or using the company's intranet. Preliminary analyses showed mean online ratings were more favorable than were mean paper-and-pencil ratings (d…

The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models…

The role of pupil assessment in ICT is often seen by teachers as problematic. This article will explore the relationship of the two and will argue that research in assessment has not kept up with the opportunities offered by ICT. Conversely, some of the new developments in "assessment for learning" have not yet found their way into ICT.…

Eighty-three Test of English as a Foreign Language (TOEFL) writing prompts administered via computer-based testing between July 1998 and August 2000 were examined for differences attributable to the response mode (handwriting or word processing) chosen by examinees. Differences were examined statistically using polytomous logistic regression. A…

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

Because technology is more prevalent and accessible for use in assessment, this article highlights what counselors and educators need to know when considering the use of computers and the Internet for that purpose. The article concludes with some predictions on how technology might influence assessment and accountability in the future. This…