This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

Reasoning skills have been clearly related to achievement in introductory undergraduate biology, a course with a high failure rate that may contribute to dropout from undergraduate STEM majors. Existing measures are focused on the experimental method, such as generating hypotheses, choosing a research method, how to control variables other than…

Undergraduate biology education reform aims to engage students in scientific practices such as experimental design, experimentation, and data analysis and communication. Graphs are ubiquitous in the biological sciences, and creating effective graphical representations involves quantitative and disciplinary concepts and skills. Past studies…

In line with the growing interest in extending the diversity of CS students, we examined the performance of a unique group of students studying an introductory course in Digital logic: ultraorthodox Jewish men, whose previous education was based mostly on studying Talmud and who lacked a conventional high-school education. We used questions from…

The current study aims to explore how children explain the concepts of biology and how biological knowledge develops across ages by focusing on the structure and functions of the digestive system. The study was conducted with 60 children. The data were collected through the interviews conducted within a think-aloud protocol. The interview data…

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

General chemistry is the first undergraduate course in which students further develop their understanding of fundamental chemical concepts. Many of these fundamental topics highlight the numerous conceptual interconnections present in chemistry. However, many students possess incoherent knowledge structures regarding these topics. Therefore,…

In this study, we considered how middle school teachers understood the relationship between fractions and ratios. We used two instruments to collect data from 11 teachers and relied on Knowledge in Pieces as a lens for considering understandings teachers have and how coherent those understandings are. From our analysis, we developed three main…

The knowledge and skills that are required for radiological image interpretation are not well documented, even though medical imaging is gaining importance. This study aims to develop a comprehensive framework of knowledge and skills, required for two-dimensional and multiplanar image interpretation in radiology. A mixed-method study approach was…

This research investigates cross-linguistic influence in the comprehension of L3 French past tense. A close examination was made on the L1 (Chinese) and L2 (English) transfer patterns among 20 English majors in their early acquisition of L3 French passé compose (PC). Data were collected through introspective think-aloud protocol in a comprehension…

The purpose of this qualitative study was to examine the decisions three teachers made to integrate technology in technology-rich elementary classrooms. An additional purpose of this study was to understand how the teachers' beliefs about technology and their knowledge of content, pedagogy, technology, and learners influenced the decisions…

Fifteen elementary and secondary teacher candidates solved sixteen integer addition and subtraction problems during think-aloud interviews. Investigators further probed participants' solution strategies as well as what they noticed first when starting a new problem. Task analyses of participants' solutions led to the creation of two distinct maps…

Internationally, efficacy studies of school-based child sexual abuse prevention programs display a series of methodological shortcomings. Few studies include adolescent participants, recording of disclosures has been inconsistent, and no studies to date have assessed presenter adherence to program protocols or summated the costs of program…

Despite public health initiatives targeting rapid action in response to symptoms of myocardial infarction (MI), people continue to delay in going to a hospital when experiencing these symptoms due to lack of recognition as cardiac-related. The objective of this research was to characterize lay individuals' knowledge of symptoms of acute myocardial…

This study describes the conceptual understanding for a series of fundamental organic concepts by fourth year chemistry students from a midsize, southeastern, state university. Student volunteers (n = 19) participated in semi-structured interviews using a think aloud protocol. The interview questions were eleven multiple choice questions selected…