Stealth assessment is intended to not only measure important competencies, but also to support their development during gameplay or within other types of immersive learning environments. It uses evidence-centered assessment design to create the models (Mislevy, Steinberg, and Almond 2003), in conjunction with a statistical scoring and accumulation…

In this study, we investigated the validity of a stealth assessment of physics understanding in an educational game, as well as the effectiveness of different game-level delivery methods and various in-game supports on learning. Using a game called "Physics Playground," we randomly assigned 263 ninth- to eleventh-grade students into four…

The current study investigated students' gameplay behavioral patterns as a function of in-game learning supports delivery timing when played a computer-based physics game. Our sample included 134 secondary students (M = 14.40, SD = .90) from all over the United States, who were randomly assigned into three conditions: receiving instructional…

In-game learning supports aim to help students solve game levels (i.e., game-related supports), and connect to underlying content (i.e., content-related and hybrid supports). Students with different levels of prior knowledge may have different needs for in-game supports. In this study, we designed a 2D physics game with game-related,…

Persistence is an important part of student success--both in and out of school. To enhance persistence, we first need to assess it accurately. Digital games can be used as vehicles for measuring and enhancing persistence. The purpose of this study is to test the effects of (a) game-level characteristics (i.e., game mechanics and conceptual…

Persistence is an important part of student success--both in and out of school. To enhance persistence, we first need to assess it accurately. Digital games can be used as vehicles for measuring and enhancing persistence. The purpose of this study is to test the effects of (a) game-level characteristics (i.e., game mechanics and conceptual…

Over three years, our research team has designed various learning supports for promoting content knowledge and solving game levels. In this case study, we examined the optimal design and the evaluation of learning support videos for a physics educational game. Often studies focus on investigating the effects of research-based principles without a…

Digital, educational games have many promises (e.g., increasing students' content knowledge as well as competencies like problem-solving, spatial skills, and persistence). However, there are challenges to overcome before using these games more broadly in educational settings. One challenge involves identifying effective, theoretically based…

We examined the use and effectiveness of an incentive system--one of the five elements of a theory-based motivational architecture in educational games that we proposed--in a computer-based physics game on students' learning and performance. The incentive system's purpose was to motivate students to access learning supports designed to facilitate…

Identifying struggling students in real-time provides a virtual learning environment with an opportunity to intervene meaningfully with supports aimed at improving student learning and engagement. In this paper, we present a detailed analysis of quit prediction modeling in students playing a learning game called Physics Playground. From the…

Well-designed digital games hold promise as effective learning environments. However, designing games that support both learning and engagement without disrupting flow is quite tricky. In addition to including various game design features (e.g., interactive problem solving, adaptive challenges, and player control of gameplay) to engage players,…

Educational games have become hugely popular, and educational data mining has been used to predict student performance in the context of these games. However, models built on student behavior in educational games rarely differentiate between the types of problem solving that students employ and fail to address how efficacious student problem…