This paper explores assessment approaches within the unique context of Extended Reality (XR) learning environments, which offer immersive and contextualized experiences. Focusing on STEM disciplines, the paper presents four distinctive XR-based assessment cases, exploring the discipline, context, purpose, and results of each. These insights aim to…

In this paper, we take a designer's look at how the activities and data of learning and assessment can be structured in immersive virtual game environments called Massively Multi-Player Online Games (MMOG). In doing so, we examine the channels of evidence through which learning and assessment activities are derived in MMOGs, offering examples of…

At a time when scientific and technological competence is vital to the nation's future, the weak performance of U.S. students in science reflects the uneven quality of current science education. Although young children come to school with innate curiosity and intuitive ideas about the world around them, science classes rarely tap this potential.…

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative…

This article describes the use of assessment in the design and implementation stages of launching online courses and programs. While use of assessment for improving student engagement in both face-to-face and online courses has been commonly used, the authors augmented the strategic planning of programs to include assessment as a tool for…

The world in which learning and assessment must take place is rapidly changing. The digital revolution has created a vast space of interconnected information, communication, and interaction. Functioning effectively in this environment requires so-called 21st century skills such as technological fluency, complex problem solving, and the ability to…

There is intense interest in computer games. A total of 65 percent of all American households play computer games, and sales of such games increased 22.9 percent last year. The average amount of game playing time was found to be 13.2 hours per week. The popularity and market success of games is evident from both the increased earnings from games,…

This study investigated novel pedagogies for helping teachers infuse inquiry into a standards-based science curriculum. Using a multi-user virtual environment (MUVE) as a pedagogical vehicle, teams of middle-school students collaboratively solved problems around disease in a virtual town called River City. The students interacted with "avatars" of…

The methodology of P. E. Holland and P. R. Rosenbaum (1986) to assess unidimensionality of binary data is outlined and illustrated through a simulation with 36 items for 2,000 examinees. How to interpret the results is discussed. (SLD)

In Scotland, one "value added" (VA) indicator of secondary school effectiveness measures students' relative "progress" between Standard and Higher grade in particular subjects. When random nonschool factors affecting students' geography performance were computer-simulated to determine VA fluctuation over 25 years, the…

This study used innovative assessment practices to obtain and document broad learning outcomes for a 15-hour game-based curriculum in Quest Atlantis, a multi-user virtual environment that supports school-based participation in socio scientific inquiry in ecological sciences. Design-based methods were used to refine and align the enactment of…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

By definition, differential item functioning (DIF) refers to unequal probabilities of a correct response to a test item by examinees from two groups when controlled for their ability differences. Simulation results are presented for an attempt to purify a test by separating out multidimensional items under the assumption that the intent of the…

Several studies were conducted in 1987 by the Multilevel Evaluation Systems Project, which focuses on developing a model for a multi-purpose, multi-user evaluation system to facilitate educational decision making and evaluation. The project model emphasizes on-going integrated assessment of individuals, classes, and programs using a variety of…

In this paper, algorithms are described for obtaining the maximum likelihood estimates of the parameters in log-linear models. Modified versions of the iterative proportional fitting and Newton-Raphson algorithms are described that work on the minimal sufficient statistics rather than on the usual counts in the full contingency table. This is…