This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

As learning center professionals, we have much to gain by conducting assessment to understand how our services help college students develop their academic strategies. The type of data we collect makes a difference in the interpretations we can draw, however. An initial step in becoming a scholarly practitioner is to consider the strengths and…

Cognitive models postulate that respondents to a questionnaire follow a four-stage process when answering a question: comprehension, memory retrieval, decision, and response. Cognitive interviewing is a qualitative tool to gain insight into this process by means of letting respondents think aloud or asking them specific questions (Willis, 2005).…

Elicitation techniques are a category of research tasks that use visual, verbal, or written stimuli to encourage participants to talk about their ideas. These tasks are particularly useful for exploring topics that may be difficult to discuss in formal interviews, such as those that involve sensitive issues or rely on tacit knowledge. Elicitation…

An operational definition offered in this paper posits learning as a multi-dimensional and multi-phase phenomenon occurring when individuals attempt to solve what they view as a problem. To model someone's learning accordingly to the definition, it suffices to characterize a particular sequence of that person's disequilibrium-equilibrium phases in…

The ability to reason with formal logic is a foundational skill for computer scientists and computer engineers that scaffolds the abilities to design, debug, and optimize. By interviewing students about their understanding of propositional logic and their ability to translate from English specifications to Boolean expressions, we characterized…

Findings derived from self-reported, structured survey questionnaires are commonly used in evaluation and applied research to inform policy-making and program decisions. Although there are a variety of issues related to the quality of survey evidence (e.g., sampling precision), the validity of response processes--how respondents process thoughts…

This article shares findings of how two third-grade children who have systematically studied history in grades K-3 analyzed historical sources on a topic about which they had no prior knowledge. In think-aloud interviews, the children analyzed written documents on the 1887 Dawes Severalty Act. One of the children, who tested on the third-grade…

Cellular processes that rely on knowledge of molecular behavior are difficult for students to comprehend. For example, thorough understanding of meiosis requires students to integrate several complex concepts related to chromosome structure and function. Using a grounded theory approach, we have unified classroom observations, assessment data, and…

Workplace needs are often difficult for English for Specific Purposes (ESP) teachers to assess due to a variety of obstacles that can restrict opportunities to analyze the existing needs. Nevertheless, the workers' needs may be recognized by employing techniques aimed at extracting information from the workers themselves. Japanese university…

Provides a systematic analysis of the cognitive processes required for acquiring skill in practical ethical reasoning in a professional domain. Reports striking differences in students' and ethicists' use of knowledge and reasoning. Points to the importance of professional knowledge and role-specific professional obligations in resolving ethical…

Considers the role of library and information science professionals as knowledge engineers. Highlights include knowledge acquisition, including personal experience, interviews, protocol analysis, observation, multidimensional sorting, printed sources, and machine learning; knowledge representation, including production rules and semantic nets;…

Generally, experts agree on what good readers do to comprehend text--they connect new text with past experiences, interpret, evaluate, synthesize, and consider alternative interpretations. Yet, traditional measures of reading comprehension only provide a general indicator of how well a student understands text. They do not provide information…