Computational thinking (CT) is a set of cognitive skills that every child should acquire. K-12 classrooms are expected to provide students opportunities (tasks) to think computationally. We introduce a CT competency assessment for middle school students. The assessment design process started by establishing a cognitive model of CT domain mastery,…

This study aims to determine the effect of learning activities conducted in accordance with the phenomenon-based learning approach on the metacognitive awareness level of students. Pre-test and post-test control group design of the experimental method was used. The application of the study was carried out in a sample of 60 students studying in the…

To achieve adaptive learning, a dynamic assessment system equipped with a cognitive diagnosis was developed for this study, which adopts a three-stage model of diagnosis-intervention-assessment. To examine how this system influenced spatial geometry learning, the study used a quasi-experimental method to investigate student learning outcomes…

This article proposes a class of cognitive diagnosis models (CDMs) for polytomously scored items with different link functions. Many existing polytomous CDMs can be considered as special cases of the proposed class of polytomous CDMs. Simulation studies were carried out to investigate the feasibility of the proposed CDMs and the performance of…

This study aimed to develop the Computational Thinking Test for Elementary School Students (CTT-ES) to assess young children's CT competencies in non-programming contexts and also examine the relationship between CT competencies and CT dispositions. A survey including a pool of CTT-ES candidate items and the Computational Thinking Scale (CTS) was…

This study investigates the reading profiles of rural Grade 5 and 6 students (N = 262), a sample with a high proportion of English language learners. We administered a battery of reading and cognitive assessments to classify students' reading profiles and evaluate if performance on cognitive measures predicted membership in particular profiles.…

In this study, we developed machine learning algorithms to automatically score students' written arguments and then applied the cognitive diagnostic modeling (CDM) approach to examine students' cognitive patterns of scientific argumentation. We abstracted three types of skills (i.e., attributes) critical for successful argumentation practice:…

In order to achieve broadening participation in computer science and other careers related to computing, middle school classrooms should provide students opportunities (tasks) to think like a computer scientist. Researchers in computing education promote the idea that programming skill should not be a pre-requisite for students to display…

Cognitive diagnosis models (CDMs) are restricted latent class models that can be used to analyze response data from educational or psychological tests. The Deterministic Input Noisy Output "AND" gate (DINA) model and the Deterministic Input Noisy Output "OR" gate (DINO) model there are two popular cognitive diagnosis models…

Learning path and learning progression have received extensive attention from broad disciplines. The existing research In the field of learning path is rarely applied in curriculum learning and teaching. Learning progression is usually constructed through observations, interviews but not quantitative analyses. With 726 Grade 8 students'…

Solving a constructed-response item usually requires successfully performing a sequence of tasks. Each task could involve different attributes, and those required attributes may be "condensed" in various ways to produce the responses. The sequential generalized deterministic input noisy "and" gate model is a general cognitive…

Scenario-based writing assessment has two salient characteristics by design: a lead-in/essay scaffolding structure and a unified scenario/topic throughout. In this study, we examine whether the scenario-based assessment design would impact students' essay scores compared to its alternative conditions, which intentionally broke the scaffolding…

In cognitive diagnosis assessment (CDA), the impact of misspecified item-attribute relations (or "Q-matrix") designed by subject-matter experts has been a great challenge to real-world applications. This study examined parameter estimation of the CDA with the expert-designed Q-matrix and two refined Q-matrices for international…

Traditionally, teachers evaluate students' abilities via their total test scores. Recently, cognitive diagnostic models (CDMs) have begun to provide information about the presence or absence of students' skills or misconceptions. Nevertheless, CDMs are typically applied to tests with multiple-choice (MC) items, which provide less diagnostic…

We report a multidimensional test that examines middle grades teachers' understanding of fraction arithmetic, especially multiplication and division. The test is based on four attributes identified through an analysis of the extensive mathematics education research literature on teachers' and students' reasoning in this content…