Can computers help with one of the most persistent challenges of large classes: the accurate and efficient measurement of student learning?

This paper describes a new ICT assessment tool that reduces multihandling of marks, comments and scores specifically where professional judgement is involved. Whereas previous ICT applications in most fields of education have focused on student learning, this tool focuses on the lecturer task of the assessment process. Unlike many ICT based…

Preventing items in adaptive testing from being over- or underexposed is one of the main problems in computerized adaptive testing. Though the problem of overexposed items can be solved using a probabilistic item-exposure control method, such methods are unable to deal with the problem of underexposed items. Using a system of rotating item pools,…

Universal Design for Learning (UDL) stands at the forefront of contemporary efforts to create access to education curricula for all students, including those with disabilities. This policy reader comprises a notably wide range of articles that address the challenges and opportunities facing policy makers as they consider UDL's implications for…

In this technical report, we describe the development and piloting of a series of mathematics progress monitoring measures intended for use with students in kindergarten. These measures, available as part of easyCBM[TM], an online progress monitoring assessment system, were developed in 2008 and administered to approximately 2800 students from…

As adaptive testing moves toward operational implementation in large scale testing programs, where it is important that adaptive tests be as parallel as possible to existing linear tests, a number of practical issues arise. This paper concerns three such issues. First, optimum item pool size is difficult to determine in advance of pool…

This paper presents a study on the generation of mathematics test items using algorithmic methods. The history of this approach is briefly reviewed and is followed by a survey of the research to date on the statistical parallelism of algorithmically generated mathematics items. Results are presented for 8 parallel test forms generated using 16…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Educational item banking presents observers with a considerable paradox. The development of test items from scratch is viewed as wasteful, a luxury in times of declining resources. On the other hand, item banking has failed to become a mature technology despite large amounts of money and the efforts of talented professionals. The question of which…

Linear programming models with 0-1 variables are useful for the construction of tests from an item bank. Most solution strategies for these models start with solving the relaxed 0-1 linear programming model, allowing the 0-1 variables to take on values between 0 and 1. Then, a 0-1 solution is found by just rounding, optimal rounding, or a…

Testing 1-2-3 is a general purpose testing system developed at the Computer-Based Education Research Laboratory at the University of Illinois for use on NovaNET computer-based education systems. The testing system can be used for: short, teacher-made quizzes, individualized examinations, computer managed instruction curriculum testing,…

The goal of this project was to develop an inexpensive, self-contained system of hardware and software to support the development, administration, and evaluation of computerized adaptive tests. Toward that goal, commercial hardware was selected and a comprehensive software called the MicroCAT Testing System was developed. The MicroCAT system was…

The effects of presenting test items in random order or in a sequence parallel to the order of presentation were studied by testing 92 undergraduates in an introductory psychology course at Emporia State University (Kansas). Two test forms, sequential (S) and random (R), of multiple-choice questions were prepared for four 1-hour examinations…

This paper contains the technical specifications, schematic diagrams, and program printout for a computer software package for the development and administration of diagnostic tests. The second version of the Diagnostic Testing Package DX consists of a PASCAL-based set of modules located in two main programs: (1) EDITTEST creates, modifies, and…

Although two-stage testing is not the most efficient form of adaptive testing, it has some advantages. In this paper, linear programming models are given for the construction of two-stage tests. In these models, practical constraints with respect to, among other things, test composition, administration time, and inter-item dependencies play an…