This study aimed to analyze second-semester organic chemistry students' problem-solving strategies, specifically focusing on the resources activated while solving problems on E2, E1, and E1cB elimination reactions. Using the theoretical framework by Elby and Hammer, we defined a resource as a unit of information used in the problem-solving…

Contemporary research that looks at self-regulated learning (SRL) as processes of learning events derived from trace data has attracted increasing interest over the past decade. However, limited research has been conducted that looks into the validity of trace-based measurement protocols. In order to fill this gap in the literature, we propose a…

Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent's thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents' thinking. An intended outcome from this special…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

There is a need for assessment items that assess complex constructs but can also be efficiently scored for evaluation of teacher education programs. In an effort to measure the construct of teacher attentiveness in an efficient and scalable manner, we are using exemplar responses elicited by constructed-response item prompts to develop…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

Clear and rigorous quantum reasoning is needed to explain quantum physical phenomena. As pillars of true quantum physical explanations, we suggest specific quantum reasoning derived from quantum physical key ideas. An experiment is suggested to support such a quantum reasoning, in which a quantized radiation field interacts with an optical beam…

This methodological review highlights the trends in empirical studies where a methodological construct (i.e. verbal reports) intersects with content (i.e. literacy research). Specifically, we synthesise research on language learners' reading in which verbal reports were deployed as a methodological tool. Questioning the long-standing assumption…

Lack of standardized measurement is one of the main factors that inhibits rigorous evaluations of financial literacy programs. However, although several scholars have developed financial self-efficacy measurements, none have been tailored for women. This article aims to develop and validate a Women's Financial Self-Efficacy Scale (WFSES). Results…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

This article documents differences between novice and experienced undergraduate students' processes of reading mathematical proofs as revealed by moment-by-moment, think-aloud protocols. We found three key reading behaviors that describe how novices' reading differed from that of their experienced peers: alternative task models, accrual of…

Critical Thinking is a transversal skill needed to face current and future challenges, longed for in school, work, and life. Paradoxically, such relevance does not always translate into tangible efforts to measure and promote it. We present the cross-cultural translation, adaptation, and validation process of Critical Thinking Mindset Self-Rating…

The Colorado Learning Attitudes about Science Survey (CLASS) is an instrument which is widely used in physics education to characterize students' attitudes toward physics and learning physics and compare them with those of experts. While CLASS has been extensively validated for use in the context of higher education institutions in the United…

In classroom learning, students need mathematical cognitive flexibility to be able to solve mathematical problems with the various ideas they express. To solve the problems, they must be able to grasp the problem, see it from various points of view, and should not be rigid thinking with one solving method. In fact, the students still lack the…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…