Item response theory (IRT) is a statistical paradigm for developing educational tests and assessing students. IRT, however, currently lacks an established graphical method for examining model fit for the three-parameter logistic model, the most flexible and popular IRT model in educational testing. A method is presented here to do this. The graph,…

This article summarizes assessment of cognitive skills through collaborative tasks, using field test results from the Assessment and Teaching of 21st Century Skills (ATC21S) project. This project, sponsored by Cisco, Intel, and Microsoft, aims to help educators around the world enable students with the skills to succeed in future career and…

How can assessments measure complex science learning? Although traditional, multiple-choice items can effectively measure declarative knowledge such as scientific facts or definitions, they are considered less well suited for providing evidence of science inquiry practices such as making observations or designing and conducting investigations.…

"Evidence-centered design" (ECD) is a comprehensive framework for describing the conceptual, computational and inferential elements of educational assessment. It emphasizes the importance of articulating inferences one wants to make and the evidence needed to support those inferences. At first blush, ECD and "educational data…

In the last decades, many education researchers have been trying to use computerized learning environments to enhance student learning. Without proper instructional supports and guidance, however, students often failed to acquire knowledge from computer-based learning activities. The objective of this study was to demonstrate how research-based…

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require "borrowing". These problems, in which the value…

Results of an initial attempt at measuring teamwork processes using computer simulation are presented, focusing on assessing team processes that emerge during the negotiation of a contract. The interaction between team members and how that interaction affects team performance were explored using a computer simulated negotiation. Participants…

A previous research report described a prototype measure of the skill of negotiation in interpersonal competency and the results of an initial validation study of that measure. This report describes the results of two further validation studies of the computer simulation negotiation skill measure. In study 1, 37 second- and third-year law students…

Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

Studies the use of computers in elementary schools as reported by principals in a survey. Discusses the survey instrument and its topics. Reports findings on drill and practice, learning new material, simulations, and problem solving. (MVL)

A scoring algorithm for performance assessments is described that is based on expert judgments but requires the rating of only a sample of performances. A regression-based policy capturing procedure was implemented for clinicians evaluating skills of 280 medical students. Results demonstrate the usefulness of the algorithm. (SLD)

Teachers College of Columbia University (New York) and the Dalton School, an independent school in New York City, have collaborated on the Dalton Technology Project and its "Archaeotype" program which presents students with a graphic simulation of an archeological site. Students simulate digging up the artifacts, use reference sources to…

Purpose: The purpose of this paper is to propose and demonstrate an evidence-based scenario design framework for assessment-based computer games. Design/methodology/approach: The evidence-based scenario design framework is presented and demonstrated by using BELLA, a new assessment-based gaming environment aimed at supporting student learning of…

Researchers at the Coast Guard Academy have designed and tested a series of exercises for assessing the development of intellectual skills in an interdisciplinary context and providing career-related motivation for continued learning. These exercises are based on realistic situations that cadets might encounter as commissioned officers in the…