This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

Evaluating the quality of university exam papers is crucial for universities seeking institutional and program accreditation. Currently, exam papers are assessed manually, a process that can be tedious, lengthy, and in some cases, inconsistent. This is often due to the focus on assessing only the formal specifications of exam papers. This study…

The goal of this paper is to find better ways to estimate the internal consistency reliability of scores on tests with a specific type of design that are often encountered in practice: tests with constructed-response items clustered into sections that are not parallel or tau-equivalent, and one of the sections has only one item. To estimate the…

Aim/Purpose: This article investigates the process of identifying and correcting hallucinations in ChatGPT-4's recall of student-written responses as well as its evaluation of these responses, and provision of feedback. Effective prompting is examined to enhance the pre-evaluation, evaluation, and post-evaluation stages. Background: Advanced Large…

In large lecture courses, it can be challenging to imagine assessing student learning in ways other than multiple-choice exams and traditional point-based grading. Inspired by major pedagogical principles shared by Maria Montessori and Thomas Jefferson and supported by current understandings of effective teaching, assessment was reimagined in a…

Intelligent systems of essay grading constitute important tools for educational technologies. They can significantly replace the manual scoring efforts and provide instructional feedback as well. These systems typically include two main parts: a feature extractor and an automatic grading model. The latter is generally based on computational and…

Despite the increasing ubiquity of computer-based tests, many general qualifications examinations remain in a paper-based mode. Insufficient and unequal digital provision across schools is often identified as a major barrier to a full adoption of computer-based exams for general qualifications. One way to overcome this barrier is a gradual…

The Ethical Reasoning in Action program leveraged program assessment data to further promote student learning based on their effective educational framework for ethical reasoning: The Eight Key Question (8KQ) strategy. A cross-disciplinary team of five core researchers launched the first constructivist qualitative inquiry into students' ethical…

Education for Sustainable Development (ESD) serves as a key accelerator for achieving the Sustainable Development Goals (SDGs), emphasizing systems thinking as an essential competency that must be cultivated in the learning process. This study investigates students' systems thinking skills within the ESD framework through assessments on…

The 21st century learning demanded students to master the 4C competencies: critical thinking and problem-solving, communication, collaboration, and creativity and innovation, with problem-solving skills significantly influencing students' cognitive learning outcomes. This study utilized the Flipped Classroom instructional model, assisted by the…

Development of scientific explanation abilities in students is an important aspect in science education. However, traditional learning methods such as textbooks and PowerPoint presentations are often less effective in improving skills due to lack of student interactivity and involvement in the learning process. This study aimed to analyze the…

Although many studies modelled writing quality by analysing basic skills (spelling, grammar, etc.), few focused on top-down compositional strategies at the discourse level. We propose that using both narrative and argument discourse modes in an argumentative essay (a multi-discourse mode [MDM] strategy) capitalizes on their complementary…

Metacognitive skills are important because they help people develop an understanding of effective strategies. This skill also helps improve one's critical thinking and creative thinking so as to be able to overcome problems in everyday life. The purpose of this research is to train students' metacognitive skills through biology learning using the…

Learning must be able to develop knowledge, skills, and mindsets so that the graduates produced have attitudes, abilities and knowledge that are integrated and skilled in life. One way to achieve learning can be done through habits of mind because the success of learning is strongly influenced by habits of mind. The purpose of this study is to as…