Assessing students' answers and in particular natural language answers is a crucial challenge in the field of education. Advances in transformer-based models such as Large Language Models (LLMs), have led to significant progress in various natural language tasks. Nevertheless, amidst the growing trend of evaluating LLMs across diverse tasks,…

Example-generation tasks have been suggested as an effective way to both promote students' learning of mathematics and assess students' understanding of concepts. E-assessment offers the potential to use example-generation tasks with large groups of students, but there has been little research on this approach so far. Across two studies, we…

The pervasive issue of cheating in educational tests has emerged as a paramount concern within the realm of education, prompting scholars to explore diverse methodologies for identifying potential transgressors. While machine learning models have been extensively investigated for this purpose, the untapped potential of TabNet, an intricate deep…

Short-Answer Grading (SAG) is a time-consuming task for teachers that automated SAG models have long promised to make easier. However, there are three challenges for their broad-scale adoption: A technical challenge regarding the need for high-quality models, which is exacerbated for languages with fewer resources than English; a usability…

This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received…

This paper first analyzed the shortcomings of the summative final exam methods which focuses only on final exams. Then, we showed the specific implementation of the quantitative formative assessment which includes objective results and subjective scores. Objective results include the traditional written chapter test score, online mid-term and…

This paper contributes to the ongoing efforts aimed at enhancing Outcome-Based Education (OBE) assessment methodologies by addressing some critical gaps and exploring new solutions. Our work focuses on two main areas: firstly, this study proposes an improved assessment method for OBE. It refines traditional approaches by classifying course…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

Purpose: Academic integrity is vital to the success and sustainability of the academic project and particularly critical in the training of ethical and informed health professionals. Yet studies have found that cheating in online exams was commonplace during the COVID-19 pandemic. With the increased use of online and blended learning…

E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering…

The process by which user experiences (UX) for children are created is uncertain, especially for deaf and hard of hearing (DHH) children. This paper seeks to (I) describe the origins of UX and child-computer interaction and to describe what is being taught to designers today; (II) use the example of digital assessment to extract insights from…

Adaptive online learning can be realized through the evaluation of the learning process. Monitoring and supervising learners' cognitive levels and adjusting learning strategies can increasingly improve the quality of online learning. This analysis is made possible by real-time measurement of learners' cognitive levels during the online learning…

This pilot study looks at how the author proactively sought to mitigate the issue of cheating when giving online tests during the Spring 2021 semester, at a time when the COVID-19 pandemic forced many teachers around the world to use modalities that involved distance learning. The genesis, implementation and results of the strategy used during the…

Learning through the internet becomes popular that facilitates learners to learn anything, anytime, anywhere from the web resources. Assessment is most important in any learning system. An assessment system can find the self-learning gaps of learners and improve the progress of learning. The manual question generation takes much time and labor.…