Traditionally, researchers employ human raters for scoring responses to creative thinking tasks. Apart from the associated costs this approach entails two potential risks. First, human raters can be subjective in their scoring behavior (inter-rater-variance). Second, individual raters are prone to inconsistent scoring patterns…

Researchers have called for undergraduate courses to update teaching frameworks based on the Modern Synthesis with insights from molecular biology, by stressing the molecular underpinnings of variation and adaptation. To support this goal, we developed a modified version of the widely used Assessing Conceptual Reasoning of Natural Selection…

Online calibration is a key technology for item calibration in computerized adaptive testing (CAT) and has been widely used in various forms of CAT, including unidimensional CAT, multidimensional CAT (MCAT), CAT with polytomously scored items, and cognitive diagnostic CAT. However, as multidimensional and polytomous assessment data become more…

Background: Verbal fluency tests (VFT) are highly sensitive to cognitive deficits. Usually, the score on VFT is based on the number of correct words produced, yet it alone gives little information regarding underlying test performance. The implementation of different strategies (cluster and switching) to perform efficiently during the tasks…

This study explores the effects of feedback type, feedback occasion, and year level on student self-assessments in higher education. In total, 126 university students participated in this randomized experiment under three experimental conditions (i.e., rubric feedback, instructor's written feedback, and rubric feedback plus instructor's written…

The main purpose of speaking education is to enable individuals to express their thoughts accurately and effectively in every environment they communicate. This is possible with the teaching plan and measurement tools for different speech types. This research focuses on students' persuasive speaking skills. In this study, we aimed to develop a…

This study aimed to develop an automated computer scoring system (ACSS) incorporating a Korean spell checker to assess students' constructed responses and to check the efficacy of this system. To accomplish this, we examined the performance of automatic spelling correction in reporting and correcting spelling errors, the interaction of gender and…

This article considers the challenges of using artificial intelligence (AI) and machine learning (ML) to assist high-stakes standardised assessment. It focuses on the detrimental effect that even state-of-the-art AI and ML systems could have on the validity of national exams of secondary education, and how lower validity would negatively affect…

Using rubrics can benefit the quality of assessment and learning. However, the conditions that stimulate or obstruct these benefits have been insufficiently studied. One underinvestigated claim is that rubrics are no substitution for good instruction and assessment and that teachers need training in utilising them. This is relevant since teachers…

Systematic analysis of undergraduate curriculum design and assessment is required to ensure real world experiences are embedded in a degree structure for a high level of information literacy (IL) attainment. IL competencies and skills are critical for successful graduate outcomes. We developed a framework using a constructive alignment approach to…

Public relations and strategic communication are offered in communication departments with a field of study largely geared toward professional communicators. The majors place a heavy emphasis on internships, which seem to be more competitive than ever. A class project can jumpstart students' preparation for entry-level positions in the industry by…

Central to the landscape of education is the understanding that instruction is fundamentally purposeful, aiming to facilitate effective learning. Grounded in this premise, instructional design emerges as a complex and multifaceted profession. In the digital era, Instructional Designers (IDs) harness technological advancements to shape robust…

In this study, we applied different text-mining methods to the originality scoring of the Unusual Uses Test (UUT) and Just Suppose Test (JST) from the Torrance Tests of Creative Thinking (TTCT)--Verbal. Responses from 102 and 123 participants who completed Form A and Form B, respectively, were scored using three different text-mining methods. The…

The crown of a successful academic career is often considered an achievement of tenure. The path to tenure may vary based on the type of Carnegie University at which one is employed. Carnegie Doctoral granting R1 Universities place a high priority on conducting research, grant writing and publishing while other Carnegie classified Universities…

Proposed is a new method of standard setting referred to as response vector for mastery (RVM) method. Under the RVM method, the task of panelists that participate in the standard setting process does not involve conceptualization of a borderline examinee and probability judgments as it is the case with the Angoff and bookmark methods. Also, the…