Purpose: This paper aims to describe the activities designed and conducted with primary school, secondary school and university students to study the integration of alternative assessment and self-assessment online tools in mathematics courses using iTest. iTest is an educational software tool born to support the continuous evaluation system…

This report is a product of Education Sector's Next Generation of Accountability initiative. The initiative seeks to strengthen public education by examining key elements of accountability, for instance, who should be responsible for student success and how they should be held responsible. The author of this report argues that technology has the…

We developed alternate forms of a math test for use in both screening students at risk of failure and monitoring their progress over time. In this technical report, we present results of the screener, used in the fall of 2009. The 48-item test was aligned to the National Council of Teachers of Mathematics (NCTM) Curriculum Focal Point Standards…

Electronic supported assessment or e-Assessment is a field of growing importance, but it has yet to make a significant impact in the Australian higher education sector (Byrnes & Ellis, 2006). Current computer based assessment models focus on the assessment of knowledge rather than deeper understandings, using multiple choice type questions,…

Purpose: The purpose of this paper is to report on the rationale behind the use of a unique paper-based individualised accounting assignment, which automated the provision to students of immediate formative and timely summative feedback. Design/methodology/approach: As students worked towards completing their assignment, the package provided…

The authors studied the testing pattern grades in four e-campus courses at Troy University with 76 graduate students. In their research, the authors found significant differences in average test grade scores between tests taken electronically without a proctor as compared to those administered using a live or a remote proctor overall. To control…

We propose an extension of the Teaching Machine project, called Quiz Generator, that allows instructors to produce assessment quizzes in the field of algorithm and data structures quite easily. This extension makes use of visualization techniques and is based on new features of the Teaching Machine that allow third-party visualizers to be added as…

In cognitive diagnosis a Q-matrix (Tatsuoka, 1983, 1990), which is an incidence matrix that defines the relationships between test items and constructs of interest, has great impact on the nature of performance feedback that can be provided to score users. The purpose of the present study was to identify meaningful skill coding categories that…

A desirable characteristic for an e-learning system is to provide the learner the most appropriate information based on his requirements and preferences. This can be achieved by capturing and utilizing the learner model. Learner models can be extracted based on personality factors like learning styles, behavioral factors like user's browsing…

According to the Quality Assurance Agency, "Assessment describes any processes that appraise an individual's knowledge, understanding, abilities or skills", and is inextricably linked to a course or programme's intended learning outcomes. It also has a fundamental effect on students' learning where it serves a variety of purposes including…

Computer-assisted testing (CAT) in counseling and therapy is becoming increasingly common due to dramatic improvements in cost-effectiveness and increased counselor familiarity with computer applications. The assumption underlying the use of CAT is that the effectiveness of counseling is improved by allocating repetitive computational and…

In computerized adaptive testing, updating parameter estimates using adaptive testing data is often called online calibration. In this paper, how to evaluate whether the adaptive testing model used for online calibration fits the item response model used sufficiently is studied. Three approaches are investigated, based on a Lagrange multiplier…

R. J. Owen (1975) proposed an approximate empirical Bayes procedure for item selection in adaptive testing. The procedure replaces the true posterior by a normal approximation with closed-form expressions for its first two moments. This approximation was necessary to minimize the computational complexity involved in a fully Bayesian approach, but…

Computerized adaptive testing procedures (CATPs) based on the graded response method (GRM) of F. Samejima (1969) and the partial credit model (PCM) of G. Masters (1982) were developed and compared. Both programs used maximum likelihood estimation of ability, and item selection was conducted on the basis of information. Two simulated data sets, one…

The specification of a computerized adaptive test, like the specification of computer-assisted instruction, is easier and can be done by personnel who are not proficient in computer programming if an authoring language is provided. The Minnesota Computerized Adaptive Testing Language (MCATL) is an authoring language specifically designed for…