Multi-angle question answering models have recently been proposed that promise to perform related tasks like question generation. However, performance on related tasks has not been thoroughly studied. We investigate a leading model called Macaw on the task of multiple choice question generation and evaluate its performance on three angles that…

Big Ideas can be seen as overarching concepts that occur in various mathematical topics and strands within a syllabus. Within our project on Big Ideas in School Mathematics, we developed instruments to measure two Big Ideas: Equivalence and Proportionality. The instruments we developed seek to assess students' ability to see these Big Ideas as…

Student Profile Pancasila is a character that characterizes Indonesian students. For this reason, the character values of Pancasila students should be instilled in schools from an early age. The purpose of this study was to construct a Pancasila student character instrument for elementary school students. This study uses a quantitative approach…

Multiple choice questions are traditionally expensive to produce. Recent advances in large language models (LLMs) have led to fine-tuned LLMs that generate questions competitive with human-authored questions. However, the relative capabilities of ChatGPT-family models have not yet been established for this task. We present a carefully-controlled…

The object of research is a statistics exam that contains problem tasks. One examiner performed two exam evaluation methods to repeatedly evaluate the exam. The goal was to compare the methods for objectivity. One of the two exam evaluation methods we call a serial evaluation method. The serial evaluation method assumes evaluation of all exam…

Culturally relevant assessments (CRA) account for multiple socio-cultural identities, experiences, and values that mediate how students know, think, and respond to test items. Given the diversity of modern classrooms, it is critical that education researchers and practitioners understand and strive to implement CRA practices. This systematic…

The purpose of this research was to develop a "Crabs in a Bucket at Schools Scale" (CBSS) measuring the perceptions of teachers regarding crab mentality in educational organizations. The data of the study was collected in 2019-2020 academic year from high school teachers working at different high schools of Aydin province, located in…

Mathematics education needs measures that can be used to research and/or evaluate the impact of professional development for constructs that are broadly relevant to the field. To address this need we developed the Priorities for Mathematics Instruction (PMI) survey consisting of two scales focused on the constructs of Explicit Attention to…

A good diagnostic assessment is one that can (i) discriminate between students of different abilities for a given skill set, (ii) be consistent with ground truth data and (iii) achieve this with as few assessment questions as possible. In this paper, we explore a method to meet these objectives. This is achieved by selecting questions from a…

This study explores different conceptualizations of creativity within an educational setting, using textual coding and network mapping on data from a creativity-focused course. Two primary conceptualizations emerged: the Freedom-Possession and Playful-Adaptation conceptualizations. Each was associated with unique practices and elements of the…

Big Ideas in school mathematics can be seen as overarching concepts that occur in various mathematical topics in a syllabus. Although there has been much interest recently in the understanding of Big Ideas, there is little research done in the assessment of Big Ideas thinking. In this paper, we discuss our research on Big Ideas in School…

Curriculum adaptation portrays the way teachers 'tweak' the curriculum. The findings of related studies are based solely on qualitative data, and there is no instrument that can determine curriculum adaptation patterns. Based on this gap, the aim of this study is to develop the Curriculum Adaptation Patterns Scale (CAPS). After examining the…

Technological advancements, particularly in artificial intelligence, significantly transform our society and work practices. Computational thinking (CT) has emerged as a crucial 21st-century skill, enabling individuals to solve problems more effectively through an automation-oriented perspective and fundamental concepts of computer science. To…

In this study, the evaluation of mathematical proficiency (MP) in one NSW Year 12 standardised exam paper was investigated. By considering the multi-strand model of MP, a literature-based criteria for scoring the assessment of MP in individual exam questions was first developed. The criteria were then applied to quantitatively evaluate the 2023…

E-learning was a vital tool for education during the global lockdown, as it was the only alternative for billions of students worldwide to continue learning amid the COVID-19 crisis. However, despite the importance and relevance of E-learning, there is a significant lack of studies that examine E-learning success under heterogeneity effects, such…