Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct…

Research has suggested that changing one's answer on multiple-choice examinations is more likely to lead to positive academic outcomes. This study aimed to further understand the relationship between changing answer selections and item attributes, student performance, and time within a population of 158 first-year medical students enrolled in a…

Students' digital technology literacy is required to develop technology-based teaching skills as prospective teachers. Therefore, students' digital technology literacy profiles must be known as a basis for learning policies. This research aims to describe the digital technology literacy profile of students as prospective elementary school…

Multidimensional forced-choice (MFC) items have been found to be useful to reduce response biases in personality assessments. However, conventional scoring methods for the MFC items result in ipsative data, hindering the wider applications of the MFC format. In the last decade, a number of item response theory (IRT) models have been developed,…

Most biology undergraduates learn about mutations in multiple classrooms throughout their college career. Understanding personalised genome test results, genome editing controversies, and the appearance of new variants of viruses or antibiotic resistant bacteria all require foundational knowledge about mutations. However, the abstract nature of…

Game-based learning environments hold significant promise for facilitating learning experiences that are both effective and engaging. To support individualised learning and support proactive scaffolding when students are struggling, game-based learning environments should be able to accurately predict student knowledge at early points in students'…

This study aims to describe the effect of the Nyerayo-based Science, Environment, Technology, and Society learning model on the scientific literacy skills of elementary school students in East Kluet District, South Aceh Regency. Learning Science, Environment, Technology, Society (SETS) has an important role in improving the scientific literacy and…

Multiple-choice question (MCQ) plays a significant role in educational assessment. Automatic MCQ generation has been an active research area for years, and many systems have been developed for MCQ generation. Still, we could not find any system that generates accurate MCQs from school-level textbook contents that are useful in real examinations.…

The Energy and Momentum Conceptual Survey (EMCS) is a multiple-choice survey that contains conceptual problems involving a variety of energy and momentum concepts covered in a typical introductory physics course for science and engineering majors. Prior studies suggest that many concepts on the survey are challenging for introductory physics…

The purpose of this study was to compare the quality of multiple choice questions (MCQs) developed using automated item generation (AIG) versus traditional methods, as judged by a panel of experts. The quality of MCQs developed using two methods (i.e., AIG or traditional) was evaluated by a panel of content experts in a blinded study. Participants…

This document provides advice on moving from in-place, closed-book examinations to open-book, remote assessment. It offers conceptual considerations, practical tips, and discusses the relative merits of two common approaches to open-book exams: those with strict time limits, and those with broad time limits ('take-home' exams).

This study aimed to develop a standardised instrument for diagnosing science misconceptions in primary school children. Following a developmental research approach using the 4-D model (Define, Design, Develop, Disseminate), 100 four-tier multiple choice items were constructed. Content validity was established through expert evaluation by six…

This work proposes a new approach for measuring long-term conceptual knowledge based on the after-instruction evolution of students' answers to a research-based, multiple-choice, single-response test. The method allows for a quantitative determination of the fraction of students that, after instruction, attain long-lasting and temporary learnings,…

This paper deals with the advantages and disadvantages to both the faculty member and to the students of using the answer-until-correct multiple-choice test format for a class specifically designed for non-STEM majors, who need a breath of knowledge science course. Comments from students are given about why they prefer answer-until-correct…