Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

In language learning contexts, writing tasks that involve reading of source texts are often used to elicit more authentic integrative language use. Thus, interests in researching these read-to-write tasks in general and as assessment tasks keep growing. This study examined and modeled the process of summary writing as a read-to-write integrated…

The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229-247, "2010"). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they…

In this article we present results of a Differential Item Functioning (DIF) study using Shealy and Stout's (1993) multidimensionality-based DIF analysis framework. In this framework, differences in test score distributions across different groups of examinees may be a result of multidimensionality if secondary dimensions (not the primary dimension…

This study investigated the validity of measures derived from a large-scale multiple-choice achievement test in mathematics, using evidence from introspective think-aloud protocols of students as they attempted test items. A small-scale study of 21 local high-school students was conducted to identify and describe cognitive processes underlying…

The cognitive processes students use in doing the 1996 science assessment of the National Assessment of Educational Progress (NAEP) were studied using two booklets from the 1993 NAEP science field test. Blocks of items from these booklets, a hands-on task block and either a conceptual/problem solving block or a theme block, were administered to 16…