We report on and validate a system for ranking the cognitive demand of mathematical tasks. In our framework, task rankings are determined by the sequences of units and unit transformations students might use to solve each task. Using this framework, we ranked a set of 10 fractions tasks. We then interviewed 12 pre-service teachers to assess the…

Background & Context: We describe the rationale, design, and initial validation of computational thinking (CT) assessments to pair with curricular lessons that integrate fractions and CT. Objective: We used cognitive models of CT (learning trajectories; LTs) to design assessments and obtained evidence to support a validity argument. Method: We…

This article describes the results of Action Research conducted in an ESP classroom of Dhofar University located in Oman. Following the call of Oman Vision 2040 to emphasize educational practices that promote the development of higher-order cognitive processes, this study raises the following question: Can an online multiple choice question (MCQ)…

Standardised educational assessments are now widespread, yet their development has given comparatively more consideration to what to assess than how to optimally assess students' competencies. Existing evidence from behavioural studies with children and neuroscience studies with adults suggest that the method of assessment may affect neural…

Recent advances in cognitive science and psychometrics have expanded the possibilities for the next generation of literacy assessment as an integrated domain (Bennett, 2011a; Deane, Sabatini, & O'Reilly, 2011; Leighton & Gierl, 2011; Sabatini, Albro, & O'Reilly, 2012). In this paper, we discuss four key areas supporting innovations in…

Relational reasoning is the foundational cognitive ability to discern meaningful patterns within an informational stream, but its reliable and valid measurement remains problematic. In this investigation, the measurement of relational reasoning unfolded in three stages. Stage 1 entailed the establishment of a research-based conceptualization of…

International large-scale assessments of achievement often have a large degree of differential item functioning (DIF) between countries, which can threaten score equivalence and reduce the validity of inferences based on comparisons of group performances. It is important to understand potential sources of DIF to improve the validity of future…

Despite the importance of writing analytically in response to texts, there are few assessments measuring students' mastery of this skill. This manuscript describes the development of a response-to-text assessment (RTA) intended for use in research. In a subsequent validity investigation we examined whether the RTA distinguished among classrooms in…

Research on factors that may promote engagement is hampered by the absence of a measure of classroom-level engagement. Literature has suggested that engagement may have 3 dimensions--affective, behavioral, and cognitive. No existing engagement scales measure all 3 dimensions at the classroom level. The Classroom Engagement Inventory (CEI) was…

The increased capabilities offered by digital technologies offer new opportunities to evaluate students' deeper knowledge and skills and on constructs that are difficult to measure using traditional methods. Such assessments can also incorporate tools and interfaces that improve accessibility for diverse students, as well as inadvertently…

Background: Negative trauma-related cognitions have been found to be a significant factor in the maintenance of post-traumatic stress disorder (PTSD) in adults. Initial studies of such appraisals in trauma-exposed children and adolescents suggest that this is an important line of research in youth, yet empirically validated measures for use with…

In this article, the authors illustrate a step-by-step process of acquiring and integrating information according to the recommendations of evidence-based practices. A case example models the process, leading to specific recommendations regarding instruments and strategies for evidence-based assessment (EBA) of attention-deficit/hyperactivity…

Twenty-two children with autism were given four tests of false belief understanding: the Sally-Anne task, two variants of the deceptive box task, and the three boxes task. The overall consistency of the children's performance was high, 77 percent either passing or failing all tasks. Convergent validity and reliability are discussed. (Contains…

The aim of the 2018 International Association for Development of the Information Society (IADIS) Cognition and Exploratory Learning in the Digital Age (CELDA) conference was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There have been advances in both cognitive…

This study explored the structure of elementary cognitive tasks (ECTs) and relations between the corresponding construct(s) with processing speed (Gs) and fluid intelligence (Gf). Participants (N=321) completed 14 ECTs, 3 Gs, and 6 Gf marker tests, all administered in paper-and-pencil format to reduce potential confounds evident when tasks are…