We investigated the effects of in-game learning supports' timing in a game called Physics Playground where we randomly assigned 149 students (M[subscript age] = 14, SD = 0.96) to receive learning supports either Before (n = 50) or After (n = 46) playing game levels--a no-support Control (n = 53) condition was included. We found that students…

Creativity has been of research interest to psychologists dating back many decades, and is currently recognized as one of the essential skills needed to succeed in our complex, interconnected world. One medium that has affordances to assess and support creativity in young people is video games. In this paper, we briefly discuss the literature on…

Over three years, our research team has designed various learning supports for promoting content knowledge and solving game levels. In this case study, we examined the optimal design and the evaluation of learning support videos for a physics educational game. Often studies focus on investigating the effects of research-based principles without a…

We conducted an exploratory study on affect regulation during game-based learning where 110 college-aged participants (M[subscript age] = 22.14, SD[subscript age] = 1.24; 50.0% female; 70.0% White) played an easy, medium, and difficult level of an educational game (Physics Playground) while self-reporting their strongest affective state and…

In honor of Jim Greer, we share our recent work--a design and development study of various learning supports embedded within the game "Physics Playground." This 2-dimensional computer game is designed to help students learn Newtonian physics and uses stealth assessment to measure, in real-time, their physics understanding. The game…

Game-based assessment (GBA) is a specific use of educational games that employs game activities to elicit evidence for educationally valuable skills and knowledge. While this approach can provide individualized and diagnostic information about students, the design and development of assessment mechanics for a GBA is a nontrivial task. In this…

One of the key ideas of evidence-centered assessment design (ECD) is that task features can be deliberately manipulated to change the psychometric properties of items. ECD identifies a number of roles that task-feature variables can play, including determining the focus of evidence, guiding form creation, determining item difficulty and…

We are using stealth assessment, embedded in "Plants vs. Zombies 2," to measure middle-school students' problem solving skills. This project started by developing a problem solving competency model based on a thorough review of the literature. Next, we identified relevant in-game indicators that would provide evidence about students'…

The study explored instructional benefits of a storyline gaming characteristic (GC) on learning effectiveness, efficiency, and engagement with the use of an online instructional simulation for graduate students in an introductory statistics course. A storyline is a game-design element that connects scenes with the educational content. In order to…

Digital games are very popular in modern culture. The authors are examining ways to leverage these engaging environments to assess and support student competencies. The authors examine gameplay and learning using a physics game they developed called Newton's Playground. The sample consisted of 167 eighth- and ninth-grade students who played…

The first challenge of accomplishing the goals of any successful instructional system depends on accurately assessing learners and leveraging the information to improve learning (e.g., Conati, 2002; Park & Lee, 2003; Shute, Lajoie, & Gluck, 2000; Snow, 1994). This paper describes an approach for modeling key competencies and developing…

To reveal what is being learned during the gaming experience, this report proposes an approach for embedding assessments in immersive games, drawing on recent advances in assessment design. Key to this approach are formative assessment to guide instructional experiences and evidence-centered design to systematically analyze the assessment argument…