This study was carried out to develop a test to assess algorithmic thinking skills. To this end, the twelve steps suggested by Downing (2006) were adopted. Throughout the test development, 24 middle school sixth-grade students and eight experts in different areas took part as needed in the tasks on the project. The test was given to 252 students…

The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most…

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

Background: Base-ten thinking (BTT) -- children's ability to reason in tens and ones is a crucial measure of Foundation Phase learners' mathematical performance in South Africa. Aim: The study looks at the six learners using BTT to solve additive tasks through two different assessments. Setting: Six purposely selected Grade 3 learners in…

Computation competence (CC) in simple addition and subtraction using non-counting (NC) strategies is an important learning objective in Grade 1 mathematics but many children, especially low achievers in mathematics, struggle to acquire these skills. To provide these students with the support they need, it is important to have valid and reliable…

Research Purpose and Contribution: The study aimed to construct an evaluation framework for assessing pupils' computational thinking (CT) during classroom learning problem solving. As a self-report evaluation scale for pupils, this evaluation framework further enriched the CT assessment instruments for pupils and provided a specialized instrument…

This study evaluates the effectiveness of non-paper-and-pencil tests (NPTs) in Chinese language education for second-grade primary students in Baoshan City, Yunnan Province. The research aims to assess how NPTs support educational goals outlined in China's "double reduction" policy, which seeks to alleviate academic pressure and promote…

Purpose: To evaluate the validity, reliability, and sensitivity of the novel Means-End Problem-Solving Assessment Tool (MEPSAT). Methods: Children with typical development and those with motor delay were assessed throughout the first 2 years of life using the MEPSAT. MEPSAT scores were validated against the cognitive and motor subscales of the…

To be able to support students' competence development in solving physics problems over the course of a lesson series effectively, teachers need a proper appreciation of students' deficiencies. As teachers commonly assess students' competence by means of written tests, teachers are challenged to interpret students' work on these tests and to…

Science learning in the 21st century should develop the abilities of the students to find solutions to the problems. This task requires a set of skills called Higher Order Thinking Skills (HOTS) and innovative assessment should be designed to gauge the acquisition of these skills. Thus, this study aimed to create an innovative HOTS-based…

Purpose -- This article comprehensively examines the existing body of literature about the assessment tools employed for evaluating higher-order thinking skills (HOTS) in mathematics within the last five years. The study endeavors to offer a comprehensive overview of measuring instruments for HOTS in mathematics, utilizing precise and up-to-date…

With the deepening of educational reform, classroom teaching constantly emphasizes the importance of context, and the simulated situational teaching method is gradually applied in the instructional design of activities. As an important part of the education and teaching process, evaluation which is the process of determining the changes in…

In this edition of Assessment News, Charles Darr uses a case study from the National Monitoring Study of Student Achievement (NMSSA) to highlight how students can benefit from activating deliberate thinking in assessments. The key message underscores the value of using assessment information to generate insights that inform better teaching and…

In this paper, we present an agenda for the research directions we recommend in addressing the issues of realizing and evaluating communication in CPS instruments. We outline our ideas on potential ways to improve: (1) generalizability in Human-Human assessment tools and ecological validity in Human-Agent ones; (2) flexible and convenient use of…

We present our analysis of 254 Calculus I final exams from U.S. colleges and universities to identify features of assessment items that necessitate qualitatively distinct ways of understanding and reasoning. We explore salient features of exemplary tasks from our data set to reveal distinctions between exam items made apparent by our analytical…