This systematic review examines 35 empirical studies featuring the use of think-aloud interviews in computational thinking (CT) research. Findings show that think-aloud interviews (1) are typically conducted in Computer Science classrooms and with K-12 students; (2) are usually combined with other exploratory CT assessment tools; (3) have the…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

Background and Aims: In educational measurement, performance assessments occupy a niche for offering a true-to-life format that affords the measurement of high-level cognitive competencies and the evidence to draw inferences about intellectual capital. However, true-to-life formats also introduce myriad complexities and can skew if not outright…

Over the last three decades, there has been increased attention on the collection and interpretation of "response processing data" to inform claims of learners' knowledge and skills (e.g., see Ercikan et al., 2010; Kobrin & Young, 2003; see also, Leighton, 2004). Response processing data are perhaps most consequential in the…

The objective of the present investigation was to compare the adequacy of two cognitive models for predicting examinee performance on a sample of algebra I and II items from the March 2005 administration of the SAT[TM]. The two models included one generated from verbal reports provided by 21 examinees as they solved the SAT[TM] items, and the…

The purpose of the study is to present research focused on validating the four algebra cognitive models in Gierl, Wang, et al., using student response data collected with protocol analysis methods to evaluate the knowledge structures and processing skills used by a sample of SAT test takers.