We consider the reference-based approach for Automatic Short Answer Grading (ASAG) that involves scoring a textual constructed student answer comparing to a teacher-provided reference answer. The reference answer does not cover the variety of student answers as it contains only specific examples of correct answers. Considering other language…

We report six experiments that examine how two essential components of a category-learning paradigm, training and feedback, can be manipulated to maximize learning and transfer of real-world, complex concepts. Some subjects learned through classification and were asked to classify hypothetical experiment scenarios as either true or non-true…

Purpose: This study aims to examine student perceptions regarding the mid-semester transition from face-to-face to online delivery in an accounting course during spring 2020. Design/methodology/approach: Due to the COVID-19 pandemic, numerous universities and colleges worldwide transitioned from face-to-face instruction to online delivery during…

This study aimed to examine the effect of using items from previous exams on students? pass-fail rates and on the psychometric properties of the tests and items. The study included data from 115 tests and 11,500 items used in the midterm and final exams of 3,910 students in the preclinical term at the Faculty of Medicine from 2014 to 2019. Data…

One way that examinees can gain an unfair advantage on a test is by having prior access to the test questions and their answers, known as preknowledge. Determining which examinees had preknowledge can be a difficult task. Sometimes, the compromised test content that examinees use to get preknowledge has mistakes in the answer key. Examinees who…

Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of…

This article provides an alternate method to assess the fit of the cultural consensus model (CCM) of Romney and colleagues to the responses of a group of informants about a domain of knowledge, and thus also to evaluate the extent of shared knowledge within a group. Criteria for judging the existence of singular culture have been articulated…

Providing feedback to students as they learn to integrate individual concepts into complex systems is an important way to help them to develop robust understanding, but it is challenging in large, undergraduate classes for instructors to provide feedback that is frequent and directed enough to help individual students. Various scaffolds can be…

Nowadays, rapid changes in science and technology increase the demand of qualified individuals who have signs of disciplined mind which is hightlighted in Howard Gardner's (2006) five minds as one type of mind. So, it is important to measure whether individuals have disciplined mind or not. Based on this idea, it is aimed to evaluate the…

Cultural consensus theory (CCT) is a data aggregation technique with many applications in the social and behavioral sciences. We describe the intuition and theory behind a set of CCT models for continuous type data using maximum likelihood inference methodology. We describe how bias parameters can be incorporated into these models. We introduce…

With the increased use of standardised mathematics assessments at the classroom level, teachers are encouraged, and sometimes required, to use data from these assessments to inform their practice. As a consequence, teacher educators and researchers are starting to focus on the development of analytical tools that will help them determine how…

Multiple choice testing is a common but often ineffective method for evaluating learning. A newer approach, however, using Immediate Feedback Assessment Technique (IF AT®, Epstein Educational Enterprise, Inc.) forms, offers several advantages. In particular, a student learns immediately if his or her answer is correct and, in the case of an…

Introduction: Judgment in the face of uncertainty is an important dimension of expertise and clinical competence. However, it is challenging to conceive continuing professional development (CPD) initiatives aimed at helping physicians enhance their clinical judgment skills in ill-defined situations. We present an online script concordance-based…

Delta's Key to the TOEFL iBT: Advanced Skill Practice is a revised and updated edition of Delta's Key to the Next Generation TOEFL Test. Since the introduction of the TOEFL iBT in 2005, there have been significant changes to some of the test questions, particularly the integrated writing and integrated speaking tasks. The new 2011 edition of…

Six Practice Tests for the iBT gives students plenty of practice as they prepare for the Internet-based TOEFL (iBT) or the new form of the institutional TOEFL (ITP). This new book/audio set contains a concise description of the TOEFL and the types of questions in each section, as well as six full-length tests that have not been published before.…