In this article, we explore the cognitive process and resources drawn upon when moderating artwork. The cognitive processes involved in the external moderation of non-exam assessments has received little attention; the few research studies that exist investigated moderation where the candidates' submissions were in mostly written form. No studies…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…

Classroom-based assessments have the potential to enhance validity by facilitating the assessment of important skills that are difficult to assess in written examinations. Such assessments tend to be marked by teachers. To ensure consistent marking standards, quality assurance procedures are needed. In the context of continued debate over the…

Notwithstanding the introduction of education multilingual policies worldwide, testing and assessment procedures still rely almost exclusively on the monolingual construct. This paper describes a study, part of a larger project fostering a new multilingual education policy in Israeli schools, exploring bi/multilingual assessment. It included two…

The Next Generation Science Standards describe students' proficiency in science in three dimensions: disciplinary core ideas (content), scientific practices, and crosscutting concepts. However, the field currently lacks high quality assessments that measure students' progress toward mastering scientific practices. In this dissertation, I developed…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

Problem solving is not simply a process that ends when an answer is found; it is a scientific process that evolves from understanding the problem to evaluating the solution. This process is affected by several factors. Among these, one of the most substantial is belief. The purpose of this study was to evaluate the beliefs of high school students…

The emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed…

This study investigated the effects of the use of scaffolds in written classroom assessments through the voices of both native English speakers and English language learners from two middle schools. Students responded to assessment tasks in writing, by speaking aloud using think aloud protocols, and by reflecting in a post-assessment interview.…

This article introduces the Main Idea Strategy, a strategy to improve the performance of students with disabilities and students who perform poorly on reading comprehension tasks. The rationale, research background, and detailed implementation information are presented.

The Berge et al. article in this volume presents the functional construct of writing that underlies summative and formative assessment of writing as a key competency in Norway. A functional construct implies that specific acts of writing and their purposes constrain what is a relevant selection among the semiotic resources that writing generally…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

A case study of a beginning teacher in an urban high school, conducted over five years including one preservice year and the first four years of teaching, describes how the teacher came to understand and amend her assessment practices through guided questioning of student work. The protocol poses questions to engage teachers in discussions about…

This article investigates whether verbal protocol analysis is a sound methodology in the context of researching examination marking processes. As part of a larger study, six examiners marked fifty scripts at home and some further scripts during meetings (some silently and some whilst thinking aloud) for two A level examinations. Some scripts were…