Researchers studying monitoring accuracy currently use two different indexes to estimate accuracy: relative accuracy and absolute accuracy. The authors compared the distributional properties of two measures of monitoring accuracy using Monte Carlo procedures that fit within these categories. They manipulated the accuracy of judgments (i.e., chance…

Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This…

The College of Business and Economics at the University of Idaho conducted a pilot study that used commercially available encryption software called Securexam to deliver computer-based examinations. A multi-step implementation procedure was developed, implemented, and then evaluated on the basis of what students viewed as valuable. Two key aspects…

This paper outlines an approach taken to produce computer-based formative assessments for two modules in a one-year taught MSc programme in Road Management and Engineering. It presents the aims of the assessments, the taxonomy adopted to ensure that the formulation of the questions addressed learning outcomes related to the development of higher…

There has been a wealth of investigation into the use of online multiple-choice questions as a means of summative assessment, however the research into the use of formative MCQs by the same mode of delivery still remains patchy. Similarly, research and implementation has been largely concentrated within the Sciences and Medicine rather than the…

Much has been written in recent years about advances in assessment technologies designed to aid decision making in the juvenile justice system. Adoption and implementation of this latest generation of actuarial tools, however, have lagged behind their development. Assessment in juvenile justice exemplifies the "science-practice gap" that…

Developed jointly by OECD member countries through the OECD's Directorate for Education, the Programme for International Student Assessment (PISA) aims to measure how far students approaching the end of compulsory education have acquired some of the knowledge and skills essential for full participation in the knowledge society. The assessment is…

To assess own actions and define individual learning needs is fundamental for professional development. The development of self-assessment skills requires practice and feedback during the course of studies. The "Interactive Examination" is a methodology aiming to assist students developing their self-assessment skills. The present study…

Many researchers have investigated the effects of students' prior knowledge upon learning chemistry, for example, the tenacity of alternative conceptions. Knowledge about learning also shapes students' learning of chemistry. This research describes the development of CHEMX, a survey instrument that measures an aspect of knowledge about learning…

Recent research studies have reported on how novices and experts differ in storing, organizing, and retrieving subject matter knowledge and on how they apply their knowledge to solve new problems. These findings have been integrated and implemented in a computer environment to help novices improve their problem-solving skills. An outline of this…

Despite improvements in educational indicators, such as enrolment, significant challenges remain with regard to the delivery of quality education in developing countries, particularly in rural and remote regions. In the attempt to find viable solutions to these challenges, much hope has been placed in new information and communication technologies…

This paper examines the educational impacts of the Berkshire Wireless Learning Initiative (BWLI), a pilot program that provided 1:1 technology access to all students and teachers across five public and private middle schools in western Massachusetts. Using a pre/post comparative study design, the current study explores a wide range of program…

This study evaluated expert system diagnoses of examinees' solutions to complex constructed-response algebra word problems. Problems were presented to three samples (30 college students each), each of which had taken the Graduate Record Examinations General Test. One sample took the problems in paper-and-pencil form and the other two on computer.…

This study attempts to estimate Structure of Learning Outcome (SOLO) levels in mathematics using the Partial Credit and Rating Scale models. A 30-item test comprising 10 testlets of 3 items each was designed and administered to 674 lower secondary school students. The items were arranged in a hierarchical manner, each testing SOLO levels in this…

The perspective of the examinee during the administration of a computerized adaptive test (CAT) is discussed, focusing on issues of test development. Item review is the first issue discussed. Virtually no CATs provide the opportunity for the examinee to go back and review, and possibly change, answers. There are arguments on either side of the…