This article considers the challenges of using artificial intelligence (AI) and machine learning (ML) to assist high-stakes standardised assessment. It focuses on the detrimental effect that even state-of-the-art AI and ML systems could have on the validity of national exams of secondary education, and how lower validity would negatively affect…

Using rubrics can benefit the quality of assessment and learning. However, the conditions that stimulate or obstruct these benefits have been insufficiently studied. One underinvestigated claim is that rubrics are no substitution for good instruction and assessment and that teachers need training in utilising them. This is relevant since teachers…

Systematic analysis of undergraduate curriculum design and assessment is required to ensure real world experiences are embedded in a degree structure for a high level of information literacy (IL) attainment. IL competencies and skills are critical for successful graduate outcomes. We developed a framework using a constructive alignment approach to…

Public relations and strategic communication are offered in communication departments with a field of study largely geared toward professional communicators. The majors place a heavy emphasis on internships, which seem to be more competitive than ever. A class project can jumpstart students' preparation for entry-level positions in the industry by…

Central to the landscape of education is the understanding that instruction is fundamentally purposeful, aiming to facilitate effective learning. Grounded in this premise, instructional design emerges as a complex and multifaceted profession. In the digital era, Instructional Designers (IDs) harness technological advancements to shape robust…

In this study, we applied different text-mining methods to the originality scoring of the Unusual Uses Test (UUT) and Just Suppose Test (JST) from the Torrance Tests of Creative Thinking (TTCT)--Verbal. Responses from 102 and 123 participants who completed Form A and Form B, respectively, were scored using three different text-mining methods. The…

The crown of a successful academic career is often considered an achievement of tenure. The path to tenure may vary based on the type of Carnegie University at which one is employed. Carnegie Doctoral granting R1 Universities place a high priority on conducting research, grant writing and publishing while other Carnegie classified Universities…

Proposed is a new method of standard setting referred to as response vector for mastery (RVM) method. Under the RVM method, the task of panelists that participate in the standard setting process does not involve conceptualization of a borderline examinee and probability judgments as it is the case with the Angoff and bookmark methods. Also, the…

Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions and recent work has considered the role of bounding approaches that provide a range of treatment impact…

Coaches require support to successfully navigate the integration of professional, interpersonal and intrapersonal knowledge to be effective within their environment. There is a need for coaches to have access to, and utilization of, a practical tool to identify and appraise elements of their coaching delivery. There is a wealth of literature on…

Students now have readily available and powerful tools to access, manipulate, combine, and visualize data. Acquiring data and visual literacy requires more than knowledge of how to use these tools. Students need to engage with assignments that challenge them to make relatively complex visualizations, interpret them, and explain why these…

Automated Essay Scoring (AES) technologies provide innovative solutions to score the written essays with a much shorter time span and at a fraction of the current cost. Traditionally, AES emphasized the importance of capturing the "coherence" of writing because abundant evidence indicated the connection between coherence and the overall…

The development and implementation of varied assessment practices is a major focus in higher education. Assessment benefits both students and teachers; it informs teachers about students' learning and misconceptions, thereby helping teachers improve teaching practices and students assess their current state of understanding. In general, the field…

One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

The study is the empirical application of Gul and Jamal's (2021) Transfer of Knowledge Index. The study presents the ranking of 17 public sector HEI by categorizing them into High, Medium, and Low transfer of knowledge activity HEI. In the process of ranking the HEI based on the transfer of knowledge, the study also highlights several issues that…