Presented at the Association for Institutional Research (AIR) in Kansas City in June 2007. This presentation explores what has been learned in the effort to maintain the ability to collect demographic information on SAT test takers when registration moved to the web. The information which is collected for research purposes include student's…

This paper uses poststructuralist theories of governmentality, agency, consumption and Barry's (2001) concept of Technological Societies, as a heuristic framework to trace the role of online education technologies in the instantiation of subjectification processes within contemporary Australian universities. This case study of the unintended…

This paper opens up a debate about policy and practice in computer-assisted assessment (CAA) of mathematics for undergraduates with specific learning difficulties e.g. dyslexia. Guidelines for designing assessments for such students are emerging and some may be transferable to CAA. Whether mathematics brings with it particular issues is unclear.…

Computer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can result in examinee scores that are artificially inflated or deflated. As such, researchers…

Since researchers acknowledged the several advantages of computerized adaptive testing (CAT) over traditional linear test administration, the issue of item exposure control has received increased attention. Due to CAT's underlying philosophy, particular items in the item pool may be presented too often and become overexposed, while other items are…

The standard error of the maximum likelihood ability estimator is commonly estimated by evaluating the test information function at an examinee's current maximum likelihood estimate (a point estimate) of ability. Because the test information function evaluated at the point estimate may differ from the test information function evaluated at an…

In this paper, we present two new methods for evaluating students' answerscripts based on the similarity measure between vague sets. The vague marks awarded to the answers in the students' answerscripts are represented by vague sets, where each element u[subscript i] in the universe of discourse U belonging to a vague set is represented by a…

This edited volume covers the range of critical trends in the use of computers and other devices for classroom teaching, online learning, professional development, school improvement, and student assessment. "Spotlight on Technology in Education" draws on expert sources including teacher-leaders, librarians, researchers, and trainers who…

In recent years, the Educational Testing System organisation has developed two models of the computer-based Test of English as a Foreign Language (TOEFL). However, the computerization of the test has shown a number of problems according to the testees' origin. This paper suggests some of these problems after conducting short interviews with four…

The use of web-based software and course management systems for the delivery of online assessments in the chemistry classroom is becoming more common. IMMEX software, like other web-based software, can be used for delivering assessments and providing feedback, but differs in that it offers additional features designed to give insights and promote…

The work aims to improve the assessment of creative problem-solving in science education by employing language technologies and computational-statistical machine learning methods to grade students' natural language responses automatically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

In the past decade, researchers have attempted to develop computer-assisted learning and testing systems to help students improve their learning performance. Conventional testing systems simply provide students with a score, and do not offer sufficient information in order to improve their learning performance. It would be of more benefit to…

Literature on coping strategies and assessments has not previously included international students, who make up approximately 4% of university students. Results of an Internet survey of 555 graduate and undergraduate international students in U.S. universities are reported. The survey included the Brief COPE, a widely used assessment of coping…

A new computerised testing system was used at home to promote learning and also to save classroom instruction time. The testing system combined the features of short-answer and multiple-choice formats. The questions of the multiple-choice problems were presented without the options so that students had to generate answers for themselves; they…