The experience of a county government illustrates factors to consider in implementing online employment testing for job candidates: (1) selection of the appropriate Internet-based test; (2) passwords, timing, security, and technical difficulties; and (3) provisions for applicants who lack Internet access. (SK)

Gives an overview of new technologies--Internet, World Wide Web, and multimedia--including their problems and limitations. Presents implications for career assessment. (SK)

Conducted a simulation study of differential item functioning (DIF) to compare the power and Type I error rates for two conditions: using an examinee's ability estimate as the conditioning variable with the CATSIB program and either using the regression correction from CATSIB or not. Discusses implications of findings for DIF detection. (SLD)

Many credentialing agencies today are either administering their examinations by computer or are likely to be doing so in the coming years. Unfortunately, although several promising computer-based test designs are available, little is known about how well they function in examination settings. The goal of this study was to compare fixed-length…

When we think about assessment using digital technologies, we often assume this means the introduction of computer-based tests. There are, however, other ways of using assessment for learning in which technology can play a useful and important role. This paper will discuss an innovative project, eVIVA, which uses mobile phones and the Internet to…

This article sets out a practitioner's perspective on the International Test Commission (ITC) guidelines. After setting the scene and describing the testing environment in which the need for the Guidelines on Computer-Based and Internet-Delivered Testing (ITC, 2005) is established, the article goes on to identify specific issues of relevance to…

In a mathematical examination on paper, partial credit is normally awarded for an answer that is not correct, but, nevertheless, contains some of the correct working. Assessment on computer normally marks an incorrect answer wrong and awards no marks. This can lead to discrepancies between marks awarded for the same examination given in the two…

A new procedure, CATSIB, for assessing differential item functioning (DIF) on computerized adaptive tests (CATs) is proposed. CATSIB, a modified SIBTEST procedure, matches test takers on estimated ability and controls for impact-induced Type 1 error inflation by employing a CAT version of the IBTEST "regression correction." The…

Practise is one of the most important steps in learning the art of computer programming. Unfortunately, human grading of programming assignments is a tedious and error-prone task, a problem compounded by the large enrolments of many programming courses. As a result, students in such courses tend to be given fewer programming assignments than…

The Hetter and Sympson (1997; 1985) method is a method of probabilistic item-exposure control in computerized adaptive testing. Setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be set conditional on a realistic…

Computer assisted assessment is becoming more and more common through further and higher education. There is some debate about how easy it will be to migrate current assessment practice to a computer enhanced format and how items which are currently re-used for formative purposes may be adapted to be presented online. This paper proposes an…

Four experiments required participants to keep track of the locations of (i.e., update) 1, 2, 3, 4, 6, 8, 10, or 15 target objects after rotating. Across all conditions, updating was unaffected by set size. Although some traditional set size effects (i.e., a linear increase of latency with memory load) were observed under some conditions, these…

No empirical studies exist comparing the effectiveness of the two prevalent foreign language methodologies, Communicative Language Teaching (CLT) and Teaching Proficiency through Reading and Storytelling (TPRS), at helping students achieve second language acquisition. In turn, the purpose of this quantitative, quasi-experimental study was to…

This dissertation reports development and validation studies of a Web-based standardized test of Japanese as a foreign language (JFL), designed to measure learners' off-line grammatical and pragmatic knowledge in multiple-choice format. Targeting Japanese majors in the U.S. universities and colleges, the test is designed to explore possible…

Most of the emphasis on mining online assessment logs has been to identify content-specific errors. However, the pattern of general "consistency" is domain independent, strongly related to performance, and can itself be a target of educational data mining. We demonstrate that simple consistency indicators are related to student outcomes,…