We consider the reference-based approach for Automatic Short Answer Grading (ASAG) that involves scoring a textual constructed student answer comparing to a teacher-provided reference answer. The reference answer does not cover the variety of student answers as it contains only specific examples of correct answers. Considering other language…

We report six experiments that examine how two essential components of a category-learning paradigm, training and feedback, can be manipulated to maximize learning and transfer of real-world, complex concepts. Some subjects learned through classification and were asked to classify hypothetical experiment scenarios as either true or non-true…

Purpose: This study aims to examine student perceptions regarding the mid-semester transition from face-to-face to online delivery in an accounting course during spring 2020. Design/methodology/approach: Due to the COVID-19 pandemic, numerous universities and colleges worldwide transitioned from face-to-face instruction to online delivery during…

This study aimed to examine the effect of using items from previous exams on students? pass-fail rates and on the psychometric properties of the tests and items. The study included data from 115 tests and 11,500 items used in the midterm and final exams of 3,910 students in the preclinical term at the Faculty of Medicine from 2014 to 2019. Data…

One way that examinees can gain an unfair advantage on a test is by having prior access to the test questions and their answers, known as preknowledge. Determining which examinees had preknowledge can be a difficult task. Sometimes, the compromised test content that examinees use to get preknowledge has mistakes in the answer key. Examinees who…

Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of…

This article provides an alternate method to assess the fit of the cultural consensus model (CCM) of Romney and colleagues to the responses of a group of informants about a domain of knowledge, and thus also to evaluate the extent of shared knowledge within a group. Criteria for judging the existence of singular culture have been articulated…

Providing feedback to students as they learn to integrate individual concepts into complex systems is an important way to help them to develop robust understanding, but it is challenging in large, undergraduate classes for instructors to provide feedback that is frequent and directed enough to help individual students. Various scaffolds can be…