Background: Online and blended learning need an appropriate assessment strategy which ensures academic integrity. During the pandemic, many universities have chosen for online proctoring. Although some earlier examples suggest that online proctoring may reduce cheating, the potential side-effects of proctoring are largely unknown. Objectives:…

Multistage adaptive testing (MST) has become popular in the testing industry because the research has shown that it combines the advantages of both linear tests and item-level computer adaptive testing (CAT). The previous research efforts primarily focused on MST design issues such as panel design, module length, test length, distribution of test…

Q methodology (Q) offers a scientific way to study subjectivity, meaning people's viewpoints about a topic. The underlying assumption of Q is that when people share an experience, they do not necessarily form the same viewpoint about that experience. This is different from the use of Likert-scale surveys that report results using aggregate…

Virtual proctoring technology is credited with increasing the accessibility of exams by enabling students to participate in exams at any time and place. In this field experiment, students were randomly assigned to virtual proctoring or traditional on-campus examination to evaluate the effect, nature and timing of implementation barriers for online…

Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

In the human-to-human Collaborative Problem Solving (CPS) test, students' problem-solving process reflects the interdependency among partners. The high interdependency in CPS makes it very sensitive to group composition. For example, the group outcome might be driven by a highly competent group member, so it does not reflect all the individual…

Understanding the concepts related to real function is essential in learning mathematics. To determine how students understand these concepts, it is necessary to have an appropriate measurement tool. In this paper, we have created a web application using 32 items from conceptual understanding of real functions (CURF) item bank. We conducted a…

This bibliometric analysis attempts to map out the scientific literature on automated writing evaluation (AWE) systems for teaching, learning, and assessment. A total of 170 documents published between 2002 and 2021 in Social Sciences Citation Index journals were reviewed from four dimensions, namely size (productivity and citations), time…

The widespread availability of internet access in daily life has resulted in a greater acceptance of online assessment methods. E-assessment platforms offer various features such as randomizing questions and answers, utilizing extensive question banks, setting time limits, and managing access during online exams. Electronic assessment enables…

Background: This study aims to assess how well several machine learning (ML) algorithms predict the physical, social, and mental health condition of university students. Objectives: The physical health measurements used in the study include BMI (Body Mass Index), %BF (percentage of Body Fat), BSC (Blood Serum Cholesterol), SBP (Systolic Blood…

Studies have indicated that pictures in test items can impact item-solving performance, information processing (e.g., time on task) and metacognition as well as test-taking affect and motivation. The present review aims to better organize the existing and somewhat scattered research on multimedia effects in testing and problem solving while…

Machine learning methods can be used to reduce the manual workload in exam grading, making it possible for teachers to spend more time on other tasks. However, when it comes to grading exams, fully eliminating manual work is not yet possible even with very accurate automated grading, as any grading mistakes could have significant consequences for…

Automatic grading models are valued for the time and effort saved during the instruction of large student bodies. Especially with the increasing digitization of education and interest in large-scale standardized testing, the popularity of automatic grading has risen to the point where commercial solutions are widely available and used. However,…

Common indicator-based approaches to identifying careless and insufficient effort responding (C/IER) in survey data scan response vectors or timing data for aberrances, such as patterns signaling straight lining, multivariate outliers, or signals that respondents rushed through the administered items. Each of these approaches is susceptible to…

Remote or online proctoring (invigilating) is a technology primarily used to improve the integrity of online examinations. The use of remote proctoring increased significantly as the world switched to online assessment during the COVID-19 pandemic. Remote proctoring received negative media attention, including concerns about user privacy,…