This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

In this article, we explore the cognitive process and resources drawn upon when moderating artwork. The cognitive processes involved in the external moderation of non-exam assessments has received little attention; the few research studies that exist investigated moderation where the candidates' submissions were in mostly written form. No studies…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…

In view of the complicated translation cognitive process, the study investigated and compared students' translation process of Chinese Classics through translation thinking path schema. Seventy-six participants learning translation courses based on parallel level in two classes of one Chinese university, some of them trained for four months…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

Assessment is an important aspect of medical education because it tests students' competence and motivates them to study. Various assessment methods, with and without images, are used in the study of anatomy. In this study, we investigated the use of extended matching questions (EMQs). To gain insight into the influence of images on the…

Assessing pragmatic knowledge in the instructed setting is seen as a complex but necessary task, which requires the design of appropriate research methodologies to examine pragmatic performance. This study discusses the use of two different research methodologies, namely those of Discourse Completion Tests/Tasks (DCTs) and verbal reports. Research…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

Traditional psychometric approaches towards assessment tend to focus exclusively on quantitative properties of assessment outcomes. This may limit more meaningful educational approaches towards workplace-based assessment (WBA). Cognition-based models of WBA argue that assessment outcomes are determined by cognitive processes by raters which are…

Being able to make claims about what students know and can do in science involves gathering systematic evidence of students' knowledge and abilities. This paper describes an assessment system designed to elicit information from students at many placements along developmental trajectories and demonstrates how this system was used to gather…

The purpose of this article is to provide teachers with examples of how to perform effective think-alouds. Twelve think-alouds are described. A rationale for their use in kindergarten through grade 5 is also included. In addition, this article was designed to provide teachers with lessons and activities to assist students in developing the ability…

Generally, experts agree on what good readers do to comprehend text--they connect new text with past experiences, interpret, evaluate, synthesize, and consider alternative interpretations. Yet, traditional measures of reading comprehension only provide a general indicator of how well a student understands text. They do not provide information…