Presented at the Association for Institutional Research (AIR) in Kansas City in June 2007. This presentation explores what has been learned in the effort to maintain the ability to collect demographic information on SAT test takers when registration moved to the web. The information which is collected for research purposes include student's…

This paper uses poststructuralist theories of governmentality, agency, consumption and Barry's (2001) concept of Technological Societies, as a heuristic framework to trace the role of online education technologies in the instantiation of subjectification processes within contemporary Australian universities. This case study of the unintended…

This paper opens up a debate about policy and practice in computer-assisted assessment (CAA) of mathematics for undergraduates with specific learning difficulties e.g. dyslexia. Guidelines for designing assessments for such students are emerging and some may be transferable to CAA. Whether mathematics brings with it particular issues is unclear.…

Computer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can result in examinee scores that are artificially inflated or deflated. As such, researchers…

Since researchers acknowledged the several advantages of computerized adaptive testing (CAT) over traditional linear test administration, the issue of item exposure control has received increased attention. Due to CAT's underlying philosophy, particular items in the item pool may be presented too often and become overexposed, while other items are…

The standard error of the maximum likelihood ability estimator is commonly estimated by evaluating the test information function at an examinee's current maximum likelihood estimate (a point estimate) of ability. Because the test information function evaluated at the point estimate may differ from the test information function evaluated at an…

In this paper, we present two new methods for evaluating students' answerscripts based on the similarity measure between vague sets. The vague marks awarded to the answers in the students' answerscripts are represented by vague sets, where each element u[subscript i] in the universe of discourse U belonging to a vague set is represented by a…

If the purpose of language learning is communication, then improving students' reading comprehension competence becomes an overall goal in language teaching. This paper examines the online resources of reading comprehension tests with non-English major college students, and tackles the problem with the teaching method of integrating web-based…

We compared the structure of discussions in a middle school mathematics classroom before (Year 1) and after (Year 2) teacher participation in professional development activities aimed at enhancing students' participation and the co-construction of mathematical ideas. Changes in the role of teacher and student were accompanied by identifiable…

Attitude, experience and competence (broadly covered by the European Computer Driving Licence syllabus) in information technology (IT) were assessed in 846 1st-year Medical Sciences Division undergraduates (2003-06) at the start of their first term. Online assessments delivered during induction workshops were presented as an opportunity for…

Purpose: The purpose of this paper is to present the design and first results of the integration of a web-based system person-centred group-activity support system (PEGASUS) in university instruction, as a means for advancing person-centred learning by supporting group activity. The PEGASUS is expected to help students and teachers in two distinct…

This study implemented an online peer assessment learning module to help 36 college students with the major of pre-school education to develop science activities for future instruction. Each student was asked to submit a science activity project for pre-school children, and then experienced three rounds of peer assessment. The effects of the…

In addition to its precision superiority over nonadaptive tests, another known advantage of computerized adaptive tests (CATs) is that they can be offered on a continuous basis. This is advantageous to examinees in terms of flexibility of test scheduling, as well as advantageous to schools and other testing centers in terms of both space and…

Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A…

The Scan-Tron Forms Analysis Package (SFAP) is a collection of integrated programs that allow an IBM-PC (or compatible) to collect data from a Scan-Tron 1200 forms reader. In addition to the basic data acquisition capability, the SFAP has additional capabilities related to the viewing and formatting of incoming data. When used in combination with…