This paper discusses the relevance of the discourse-based interview (DBI) for holistic research and access to more layers of meaning in the study of complex phenomena. We draw on our own work in workplace discourse and relevant research from different linguistic traditions, particularly sociolinguistic inquiry. We reflect on the potential of DBI…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

Due to time constraints, interviews aimed to detect deception in airport settings should be brief and veracity assessments should be made in real time. In two experiments carried out in the departure hall of an international airport, truth tellers were asked to report truthfully their forthcoming trip, whereas liars were asked to lie about the…

This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

Background: Developing self-directed learning (SDL) skills in engineering students is critical to support life-long learning. This research was conducted at Iron Range Engineering (IRE), an innovative, problem-based learning (PBL) engineering program, which has suffused the concept of metacognition throughout its curriculum. Purpose/Hypotheses:…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

As learning center professionals, we have much to gain by conducting assessment to understand how our services help college students develop their academic strategies. The type of data we collect makes a difference in the interpretations we can draw, however. An initial step in becoming a scholarly practitioner is to consider the strengths and…

Models of physical systems are used to explain and predict experimental results and observations. The Modeling Framework for Experimental Physics describes the process by which physicists revise their models to account for the newly acquired observations, or change their apparatus to better represent their models when they encounter discrepancies…

Rater cognition or "think-aloud" studies have historically been used to enhance rater accuracy and consistency in writing and language assessments. As assessments are developed for new, complex constructs from the "Next Generation Science Standards (NGSS)," the present study illustrates the utility of extending…

The purpose of this study was to gain insight into 30, first year calculus students' understanding of the relationship between the concept of vertex of a quadratic function and the concept of the derivative. APOS (action-process-object-schema) theory was applied as a guiding framework of analysis on student written work, think-aloud and follow up…

Context-based learning aims to make learning more meaningful by raising meaningful problems. However, these types of problems often require reflection and thinking processes that are more complex and thus more difficult for students, putting high demands on students' problem-solving capabilities. In this paper, students' approaches when solving…

Zero-order systems provide an interesting opportunity for students to think about the underlying mechanism behind the physical phenomena being modeled. The work reported here is part of a larger study that seeks to characterize how students integrate chemistry and mathematics in the context of chemical kinetics. Thirty-six general chemistry…

Previous studies have examined the online research behaviors of graduate students in terms of how they seek and retrieve research-related information on the Web across diverse disciplines. However, few have focused on graduate students' searching activities, and particularly for their research tasks. Drawing on Kuiper, Volman, and Terwel's (2008)…

This paper is concerned with organizational principles of a pool of familiar problems of expert problem posers and the ways by which they are utilized for creating new problems. The presented case of Leo is part of a multiple-case study with expert problem posers for mathematics competitions. We present and inductively analyze the data collected…