Design thinking holds the key to innovation processes, but is often difficult to detect because of its implicit nature. We undertook a study of novice designers engaged in team-based design exercises in order to explore the correlation between design thinking and designers' physical (observable) behavior and to identify new, objective, design…

Statistical literacy and statistical reasoning are important learning goals that instructors aim to develop in statistics students. However, there is a lack of clarity regarding the relationship among these learning goals and to what extent they overlap. The REasoning and Literacy Instrument (REALI) was designed to concurrently measure statistical…

This qualitative study sought to understand the reasoning of pre-service teachers through think-aloud interviews with teacher education students at the beginning of their postgraduate degree (six elementary and six secondary). Interviews focused on contextualised and challenging teaching scenarios with a range of response options previously…

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

Although test scores from similar tests in multiple choice and constructed response formats are highly correlated, equivalence in rankings may mask differences in substantive strategy use. The author used an experimental design and participant think-alouds to explore cognitive processes in mathematical problem solving among undergraduate examinees…

This study explored the effects of alternative forms of argumentation on undergraduates' physics solutions in introductory calculus-based physics. A two-phase concurrent mixed methods design was employed to investigate relationships between undergraduates' written argumentation abilities, conceptual quality of problem solutions, as well…

In order to better understand how to design hands-on child-computer interaction, we explore how different styles of interaction facilitate children's thinking while they use their hands to manipulate objects. We present an exploratory study of children solving a spatial puzzle task. We investigate how the affordances of physical, graphical…

This action research project report documents the action research project that was conducted to improve reading comprehension with second grade and third grade students. The teacher researchers intended to improve reading comprehension by using higher-order thinking skills such as predicting, making connections, visualizing, inferring,…

This study examines the effect of training in think alouds on literal and higher-order reading comprehension. Thirty-two (n = 32) eighth grade students of English as a foreign language (EFL) participated in the study. The participants were randomly assigned to control and experimental conditions. Descriptive statistics, correlation coefficients,…