Statistical process control (SPC) charts have been widely used in the field of educational measurement. The cumulative sum (CUSUM) is an established SPC method to detect aberrant responses for educational assessments. There are many studies that investigated the performance of CUSUM in different test settings. This paper describes the CUSUM…

Educational assessments often require uniform test forms, for which each test form has equivalent measurement accuracy but with a different set of items. For uniform test assembly, an important issue is the increase of the number of assembled uniform tests. Although many automatic uniform test assembly methods exist, the maximum clique algorithm…

One of the key ideas of evidence-centered assessment design (ECD) is that task features can be deliberately manipulated to change the psychometric properties of items. ECD identifies a number of roles that task-feature variables can play, including determining the focus of evidence, guiding form creation, determining item difficulty and…

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Competency-based assessment and an emphasis on obtaining higher-level outcomes that reflect physicians' ability to demonstrate their skills has created a need for more advanced assessment practices. Simulation-based assessments provide medical education planners with tools to better evaluate the 6 Accreditation Council for Graduate Medical…

While the potentials of virtual worlds to support experiential learning in medical education are well documented, assessment of student learning within these environments is relatively scarce and often incongruent. In this article, a conceptual framework is proposed for formatively assessing dispositional behaviours in scenario-based learning…

This edited volume provides an overview of the latest advancements in adaptive training technology. Intelligent tutoring has been deployed for well-defined and relatively static educational domains such as algebra and geometry. However, this adaptive approach to computer-based training has yet to come into wider usage for domains that are less…

This work describes a new "Moodle" module developed to give support to the practical content of a basic computer organization course. This module goes beyond the mere hosting of resources and assignments. It makes use of an automatic checking and verification engine that works on the VHDL designs submitted by the students. The module automatically…

People use external knowledge representations (EKRs) to identify, depict, transform, store, share, and archive information. Learning how to work with EKRs is central to becoming proficient in virtually every discipline. As such, EKRs play central roles in curriculum, instruction, and assessment. Five key roles of EKRs in educational assessment are…

We illustrate a class of multidimensional item response theory models in which the items are allowed to have different discriminating power and the latent traits are represented through a vector having a discrete distribution. We also show how the hypothesis of unidimensionality may be tested against a specific bidimensional alternative by using a…

This kit contains everything needed to explain, criticize and plan, simulate, and evaluate a management by objectives (MBO) program. The kit has been field tested in state agencies, schools, businesses, and volunteer organizations. Rather than present only the strengths of MBO, this program defines MBO, presents its strong points in discussing the…

Presents a design framework that incorporates integrated structures for modeling knowledge and skills, designing tasks, and extracting and synthesizing evidence. Illustrates these ideas in the context of a project that assesses problem solving in dental hygiene through computer-based simulations. (SLD)

A new methodology was used to measure the impact of a simulation workshop on job behaviors of adult education administrators who demonstrated significant changes 10 months after their inservice experience. (CT)

Describes and evaluates a simulation game which was developed to help undergraduate students in sociology apply sociological principles to a study of family and marital interactions. Evaluations indicated that most students enjoyed the game and believed they learned sociological principles from their participation. (Author/DB)

Describes an educational evaluation simulation activity developed for use in an English-as-a-second-language teacher training program for teachers from Southeast Asian and Pacific nations. The simulation provided opportunities for participant teams to practice educational and curriculum development assessment. Simulation objectives, theoretical…