In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible…

This paper reports the results of a study into the quality of peer feedback provided by students within a computerised peer-assessment environment. The study looks at the creation of a "feedback index" that represents the quality of an essay based upon the feedback provided during a peer-marking process and identifies a significant…

Computing-related programmes and modules have many problems, especially related to large class sizes, large-scale plagiarism, module franchising, and an increased requirement from students for increased amounts of hands-on, practical work. This paper presents a practical computer networks module which uses a mixture of online examinations and a…

In constrained adaptive testing, the numbers of constraints needed to control the content of the tests can easily run into the hundreds. Proper initialization of the algorithm becomes a requirement because the presence of large numbers of constraints slows down the convergence of the ability estimator. In this paper, an empirical initialization of…

The case of adaptive testing under a multidimensional logistic response model is addressed. An adaptive algorithm is proposed that minimizes the (asymptotic) variance of the maximum-likelihood (ML) estimator of a linear combination of abilities of interest. The item selection criterion is a simple expression in closed form. In addition, it is…

The 10th International Conference on Educational Data Mining (EDM 2017) is held under the auspices of the International Educational Data Mining Society at the Optics Velley Kingdom Plaza Hotel, Wuhan, Hubei Province, in China. This years conference features two invited talks by: Dr. Jie Tang, Associate Professor with the Department of Computer…

Purpose: The benefits of an educational shift to graduate attribute development have been foregrounded in the educational literature since the early 1990s. Attribute mapping in documentation with no change to assessment constitutes a surface approach. This paper aims to use as an example a deep approach that uses software to facilitate staff and…

Within large scale educational assessment agencies in the UK, there has been a shift towards assessors marking digitally scanned copies rather than the original paper scripts that were traditionally used. This project uses extended essay examination scripts to consider whether the mode in which an essay is read potentially influences the…

In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or…

Nine methods for automated test construction are described. All are based on the concepts of information from item response theory. Two general kinds of methods for the construction of parallel tests are presented: (1) sequential test design; and (2) simultaneous test design. Sequential design implies that the tests are constructed one after the…

In an invitational address to the Victorian Institute of Educational Research, the author discussed Bayesian theory and its relationship to the design and construction of tailored or adaptive tests. Bayesian thinking involves recognizing the role of prior probabilities and using these probabilities in combination with new data to arrive at future…

Conducted two experiments to determine whether scores on computerized test would differ significantly from scores on paper-and-pencil format. College students (Study 1, n=24; Study 2, n=400+) completed the Verbal Reasoning test of the Differential Aptitude Tests. Results showed reduced performance on computerized version of test. Reduced…

The massive examination leakages, demand for gratification by teachers, bribe-taking by supervisors and invigilators of examinations have become a global phenomenon. This menace has resulted to general fallen standards of education and Nigeria is no exception, particularly among developing nations. Consequent upon this, all Nigerian universities…

Recent theoretical conceptions of transition have emphasised the key influence of educational transition on young children's learning. The Foundation Stage was established in England in 2000, creating a distinct phase of education for children aged three to five, which spans the transition to school. In the Foundation Stage children learn through…

This article explores the effect on assessment of "translating" paper and pencil test items into their computer equivalents. Computer versions of a set of mathematics questions derived from the paper-based end of key stage 2 and 3 assessments in England were administered to age appropriate pupil samples, and the outcomes compared.…