Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

Through creative thinking, it is possible to acquire new attitudes and a view of the world, not only of mathematics but from several sides (Kamp, 2016). Creativity in mathematics can be defined as a process based on sensitivity to problems, deficiencies, gaps in knowledge and sensitivity to identifying missing elements, revealing difficulties in…

The study aimed to analyze the content validation of the STEM-integrated on thermal and transport concept inventory instrument used to measure the problem-solving abilities of high school students. The instrument questions developed amounted to nine description questions. This type of study is development research. The steps in this research are…

This study aimed to develop and validate the Creative Problem-Solving Skills Test (CPSS-T), grounded in Torrance's creativity theory, to assess these skills in university students. The CPSS-T consists of five open-ended question types, each designed to measure different aspects of creative problem-solving: Alternative Use, Hypothetical Scenario,…

Purpose: The purpose of this study is to investigate the accuracy and creativeness of ChatGPT in the domain of quantitative aptitude. Design/methodology/approach: ChatGPT 3.5 is used to generate multiple-choice quantitative aptitude questions. A total of 1,100 questions were created across 11 different areas of quantitative aptitude. A dataset is…

The response process of problem-solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data-driven approach to explore the latent states and state transitions underlying problem-solving process to reflect…

In the rapidly evolving interdisciplinary field of quantum information science and technology, a major obstacle is the need to understand advanced mathematics to solve complex problems. Current findings in educational research suggest that incorporating visualizations into problem-solving settings can have beneficial effects on students'…

Developing structure sense is an important part of learning algebra. We investigated learners' structure sense of algebraic expressions involving brackets. This led us to propose the constructs "surface structure" sense and "systemic structure" sense. Using a random sample of 58 Grade 10 learners scoring above 40% in a test, we…

Background: Students take many tests and exams during their school career, but they usually receive feedback about their test performance based only on an analysis of the item responses. With the increase in digital assessment, other data have become available for analysis as well, such as log data of student actions in online assessment…

Limited research has been conducted on the spatial ability of veterinary students and how this is evaluated within anatomy assessments. This study describes the creation and evaluation of a split design multiple-choice question (MCQ) assessment (totaling 30 questions divided into 15 non-spatial MCQs and 15 spatial MCQs). Two cohorts were tested,…

Although it is widely known that reading plays a significant role in mathematics performance, it remains unclear how specific reading component skills and item characteristics are associated with adults' mathematics performance. The aim of this study was to investigate reading component skills (printed vocabulary, sentence processing, passage…

Testing programs have explored the use of technology-enhanced items alongside traditional item types (e.g., multiple-choice and constructed-response items) as measurement evidence of latent constructs modeled with item response theory (IRT). In this report, we discuss considerations in applying IRT models to a particular type of adaptive testlet…

The aim of the study was to evaluate the extended version of the Problem-Solving Inventory (PSI) via an online learning setting known as the Online Problem-Solving Inventory (OPSI) through the lens of Rasch Model analysis. To date, there is no extended version of the PSI for online settings even though many researchers have used it; thus, this…

Background: One area that has been dramatically changed by artificial intelligence (AI) is educational environments. Chatbots, Recommender Systems, Adaptive Learning Systems and Large Language Models have been emerging as practical tools for facilitating learning. However, using such tools appropriately is challenging. In this regard, the…

Numerous studies compared the effectiveness of various formats of video-based teaching, yet their focus has primarily been on relatively straightforward content, such as concepts and basic procedures. Research on the effectiveness of teaching complex content through different formats of videos remains limited. This study addresses this gap by…