On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

The recent National Research Council (NRC) report, "Knowing What Students Know: The Science and Design of Educational Assessment," suggests that it is time to rethink the basic assumptions underlying assessment of students and the use of measurement data to enhance teaching and learning. This essay draws on arguments developed in the NRC report to…

Describes a three-phase process model for interface design, drawing on practices developed in the software industry and adapting them for computer-based languages tests. Describes good practice in initial design, emphasizes the importance of usability testing, and argues that only through following a principled approach to interface design can the…

From 2005 to 2008, the International Development Research Centre (IDRC) is funding a series of distance education (DE) studies in its Pan Asia Networking (PAN) region. Eight collaborative projects are under way in Bhutan, Cambodia, China, Hong Kong, India, Indonesia, Laos, Mongolia, Pakistan, the Philippines, Sri Lanka, Thailand, and Viet Nam. The…

This paper argues that the most important role the intelligent videodisc can fulfill is to provide a mechanism for effectively integrating testing and instruction. This integration will produce at least four important benefits: (1) increased learning by the student, (2) more interesting instructional materials, (3) gains in the efficiency of…

An item-selection algorithm to neutralize the differential effects of time limits on scores on computerized adaptive tests is proposed. The method is based on a statistical model for the response-time distributions of the examinees on items in the pool that is updated each time a new item has been administered. Predictions from the model are used…

The symposium, "Taming the Rasch Tiger: Using Item Response Theory in Practical Educational Measurement," was organized to deemphasize the technical complexities of item response theory (IRT) and to show the audience how IRT can be used in practical educational measurement. Four papers from the symposium are summarized and comments are…

Examines ways in which intelligent tutoring systems can be used to develop models of a student's domain knowledge, problem solving abilities, and learning strategies. Cognitive skills assessment is discussed, and an example of a problem based tutoring system, Qualitative Understanding of Electrical System Troubleshooting (QUEST), is explained. (25…

Potential benefits of using item response theory in test construction are evaluated, based on the experience and evidence accumulated during 9 years of using a three-parameter model in the construction of major achievement batteries. Specific benefits covered include obtaining sample-free item calibrations and item-free person measurement,…

The use of systems theory as a conceptual framework is proposed as useful when considering computers as a machine component in teaching. Skinner's proposal that the label "computer" is inaccurate and counterproductive when used to refer to a machine being used for teaching is discussed. It is suggested that the alternative label…

This article discusses the crisis-coping model of school psychology practice, the problems brought about by this model, and the advantages of a preventive approach. It then describes the Barclay Classroom Assessment System, a multi-trait, multi-method assessment procedure that utilizes rating technology and computer synthesis to implement a…

The computer can be incorporated into educational assessment at two levels: clerical work such as scoring, converting scores, administering test items, and organizing data into manageable profiles; and expanding horizons and deepening the understanding of what is important to measure and how best to measure it through expert systems and new…

Discussion of courseware evaluation for computer-based training (CBT) highlights the CITAR Computer Courseware Evaluation Model (CCEM), which was developed at the Center for Interactive Technology, Applications, and Research (CITAR) at the University of South Florida. Instructional and interactive characteristics of commercially available CBT…

The potential value of developing item banks that would both guarantee the quality of teacher-made examinations and allow for national comparison of student achievement is described. Use of Rasch model methods, rather than classical item analysis techniques, to calibrate the items for these banks is illustrated. (BS)

For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…