Background and Aims: In educational measurement, performance assessments occupy a niche for offering a true-to-life format that affords the measurement of high-level cognitive competencies and the evidence to draw inferences about intellectual capital. However, true-to-life formats also introduce myriad complexities and can skew if not outright…

Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

Cultivating students' design abilities can be highly beneficial for the learning of science, technology, engineering, and mathematics (STEM) concepts, and development of higher-order thinking capabilities (National Academy of Engineering and National Research Council in STEM integration in k-12 education: status, prospects, and an agenda for…

Given the current methodological interest in eliciting direct data on the cognitive processes L2 learners employ as they interact with L2 data during the early stages of the learning process, this article takes a critical and comparative look at three concurrent data elicitation procedures currently employed in the SLA literature: Think aloud (TA)…

The internal design thinking behaviour of designers in the concept development has been an important issue of cognitive psychology. In this study, the design thinking process designers have in applying digital media and traditional paper in the early concept development stage was explored. Special focus was made on the structure and procedure of…

Since its establishment, psychology has struggled to find valid methods for studying thoughts and subjective experiences. Thirty years ago, Ericsson and Simon (1980) proposed that participants can give concurrent verbal expression to their thoughts (think aloud) while completing tasks without changing objectively measurable performance (accuracy).…

The judgement processes underpinning examination marking are central to achieving fair assessment but are under-researched. This article draws on existing literature and uses additional analysis of data collected in a previous article "Exploring the nature of examiner thinking during the process of examination marking", to start to piece together…

Increasingly, multi-representational educational technologies are being deployed in science classrooms to support science learning and the development of representational competence. Several studies have indicated that students experience significant challenges working with these multi-representational displays and prefer to use only one…

This paper demonstrates and discusses the use of think aloud protocols (TAPs) as an approach for examining and confirming sources of differential item functioning (DIF). The TAPs are used to investigate to what extent surface characteristics of the items that are identified by expert reviews as sources of DIF are supported by empirical evidence…

The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229-247, "2010"). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they…

Research has shown that the tools provided by dynamic geometry systems (DGSs) impact students' approach to investigating open problems in Euclidean geometry. We particularly focus on cognitive processes that might be induced by certain ways of dragging in Cabri. Building on the work of Arzarello, Olivero and other researchers, we have conceived a…

The purpose of this study was to investigate novices learning to use a mission planning system. Novice participants received one training session, followed by three test sessions. This was compared to expert performance. During the test sessions, all participants were required to "think aloud", based on Ericsson and Simon's (Ericsson, K.A. and…

In this investigation we assessed whether different formats of media (video, text, and video + text) influenced participants' engagement, cognitive processing and recall of non-fiction cases of people diagnosed with HIV/AIDS. For each of the cases used in the study, we designed three informationally-equivalent versions: video, text, and video +…

The purpose of the present study is to examine the effectiveness of a metacognitive prompts intervention-science (MPI-S), which is based on the nature of science with 162 eighth-grade science students. It was hypothesised that students exposed to the intervention will show higher levels of content knowledge and knowledge about the nature of…

Purpose: The purpose of this study was to explore the usefulness of a simplified version of cognitive response analysis (CRA) as a formative evaluation tool for health education materials developed for small, unfunded projects. Design/methodology/approach: A group of women (n=15), aged between 25 and 50 years, provided cognitive responses (CRs)…