Objectively scoring constructed-response items on educational assessments has long been a challenge due to the use of human raters. Even well-trained raters using a rubric can inaccurately assess essays. Unfolding models measure rater's scoring accuracy by capturing the discrepancy between criterion and operational ratings by placing essays on an…

Evaluating the quality of university exam papers is crucial for universities seeking institutional and program accreditation. Currently, exam papers are assessed manually, a process that can be tedious, lengthy, and in some cases, inconsistent. This is often due to the focus on assessing only the formal specifications of exam papers. This study…

The goal of this paper is to find better ways to estimate the internal consistency reliability of scores on tests with a specific type of design that are often encountered in practice: tests with constructed-response items clustered into sections that are not parallel or tau-equivalent, and one of the sections has only one item. To estimate the…

Aim/Purpose: This article investigates the process of identifying and correcting hallucinations in ChatGPT-4's recall of student-written responses as well as its evaluation of these responses, and provision of feedback. Effective prompting is examined to enhance the pre-evaluation, evaluation, and post-evaluation stages. Background: Advanced Large…

In large lecture courses, it can be challenging to imagine assessing student learning in ways other than multiple-choice exams and traditional point-based grading. Inspired by major pedagogical principles shared by Maria Montessori and Thomas Jefferson and supported by current understandings of effective teaching, assessment was reimagined in a…

Efficient constructed response (CR) scoring requires both accuracy and speed from human raters. This study was designed to determine if setting scoring rate expectations would encourage raters to score at a faster pace, and if so, if there would be differential effects on scoring accuracy for raters who score at different rates. Three rater groups…

Higher-order thinking skills (HOTS) is one of the skills needed for 21st century challenges, especially for students. The aim of this study was to describe HOTS in students, especially the cognitive domain of analyzing and evaluating. This is a descriptive quantitative study employing a Pretest-Posttest One Group research design. The experiment…

The educational value of portfolios as assessments has been widely acknowledged across the higher education sector and literature as providing a platform to promote student-centred and reflective learning (Brown, 1997; Snadden & Thomas, 1998; Karlowicz, 2000). While there is plentiful research investigating the benefits of providing portfolios…

Despite the increasing ubiquity of computer-based tests, many general qualifications examinations remain in a paper-based mode. Insufficient and unequal digital provision across schools is often identified as a major barrier to a full adoption of computer-based exams for general qualifications. One way to overcome this barrier is a gradual…

Education for Sustainable Development (ESD) serves as a key accelerator for achieving the Sustainable Development Goals (SDGs), emphasizing systems thinking as an essential competency that must be cultivated in the learning process. This study investigates students' systems thinking skills within the ESD framework through assessments on…

The 21st century learning demanded students to master the 4C competencies: critical thinking and problem-solving, communication, collaboration, and creativity and innovation, with problem-solving skills significantly influencing students' cognitive learning outcomes. This study utilized the Flipped Classroom instructional model, assisted by the…

Development of scientific explanation abilities in students is an important aspect in science education. However, traditional learning methods such as textbooks and PowerPoint presentations are often less effective in improving skills due to lack of student interactivity and involvement in the learning process. This study aimed to analyze the…

Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

Assessment of problem-solving skills for preservice teachers is important in science instruction. The purpose of this study is to discover; (a) How are the characteristics of the Problem-Solving Essay Test Instrument (PSETI); (b) How is the validity based on experts assessment; (c) how are the validity and reliability based on trials. The research…

The structure and function relationship is a core concept identified by physiology faculty. Prior research has shown this may be a difficult concept for students to understand. Formative written assessments, such as short answer essay questions, allow students to demonstrate their thinking by encouraging students to use their diverse ideas to…