Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

In this study, we investigated whether incorporating eye tracking into cognitive interviewing is effective when pretesting survey questions. In the control condition, a cognitive interview was conducted using a standardized interview protocol that included pre-defined probing questions for about one-quarter of the questions in a 52-item…

This paper investigates the relationship between blank and non-blank email subject lines on levels of response to a solicitation to participate in an interview, and on participation in a web survey. Email use has grown substantially in recent years, presenting significant opportunity to the empiricist seeking research respondents. However,…

Achievement goal theory is one of the most popular theories of achievement motivation. Techniques researchers have used to assess goals include standardized questionnaires and interviews. One curious finding is that participants whose self-report questionnaire responses strongly indicate they operate with a performance goal do not make performance…

This paper describes a method aimed at pointing out the quality of the mental models undergraduate engineering students deploy when asked to create explanations for phenomena or processes and/or use a given model in the same context. Student responses to a specially designed written questionnaire are quantitatively analyzed using…

In contrast to the extant quantitative studies on the hindsight effect, the present narrative analysis looks at it from a rare angle of talk-in-interaction. Fifty one-to-one interviews were done with five student groups, each of which was presented with a scenario ending with one factual outcome and three alternative outcomes that actually did not…

In order to unify two major theories of moral judgment, a novel task is employed which combines elements of Kohlberg's stage theory and of the theory of information integration. In contrast to the format of Kohlberg's moral judgment interview, a nonverbal and quantitative response which makes low demands on verbal facility was used. Moral…

Research into the lives of children with acquired brain injury (ABI) often neglects to incorporate children as participants, preferring to obtain the opinions of the adult carer (e.g. McKinlay et al., 2002). There has been a concerted attempt to move away from this position by those working in children's research with current etiquette…

This article seeks to contribute to the idea of "posthumanist education" by unfolding an educational situation where an assemblage of two humans and 33 former battery hens is gathered to carry out a so-called cognitive bias experiment for two days. A Deleuzian repertoire is set in motion to configure the dynamics of hens intervening in…

This article reports methodological aspects of a research study on the reasoning of teachers. The aim is to describe and evaluate the use of the stimulated recall method (STR) when information and communication technologies (ICTs) are involved in terms of educational settings and therefore in the research setting as well. First, we introduce the…

A clinical task-based interview can be seen as a situation where the interviewer-interviewee interaction on a task is regulated by a system of explicit and implicit norms, values, and rules. This paper describes how documenting and mapping triadic interaction among the interviewer, the interviewee, and the knowledge negotiated can be used to…

With an increasing body of research on the roles of cognitive factors in SLA, the status of verbal reports as a cognitive measure is beginning to be established. However, little SLA research has assessed their validity in terms of reactivity (the effect of verbalisation on learners' performance). The current study investigates whether stimulated…

This study revisits a classic yet still intriguing question regarding information technology (IT): what difference does IT "really" make, in terms of people's thinking? In order to explore this question, the effects of IT in authentic research settings were studied through retrospective interviews with 24 academic researchers. Analysis of the…

Problem finding is a creative process whereby individuals develop original ideas for study. Secondary science students who successfully participate in authentic, novel, open inquiry studies must engage in problem finding to determine viable and suitable topics. This study examined problem finding strategies employed by students who successfully…

Confidence intervals are beginning to play an increasing role in the reporting of research findings within the social and behavioral sciences and, consequently, are becoming more prevalent in beginning classes in statistics and research methods. Confidence intervals are an attractive means of conveying experimental results, as they contain a…