This study examined the problems that pre-service teachers face in the online assessment process and their suggestions for solutions to these problems. The participants were 136 pre-service teachers who have been experiencing online assessment for a long time and who took the Foundations of Open and Distance Learning course. This research is a…

Introduction: Despite the necessity for adults with lower literacy skills to undergo and succeed in high-stakes computer-administered assessments (e.g., GED, HiSET), there remains a gap in understanding their engagement with digital literacy assessments. Methods: This study analyzed process data, specifically time allocation data, from the Program…

This non-consecutive, three-year qualitative study explored the testing experiences of high school juniors who used Chromebooks to take their Smarter Balanced Standardized Assessments (SBAC) in English Language Arts and Mathematics. The study began in 2015, the first year in which SBAC was administered to students across California and other…

During the COVID pandemic, universities around the globe had to move not only their content delivery online, but also their assessments. Due to COVID causing significant upheaval in Higher Education (HE), this enforced experiment also afforded an opportunity to reflect on traditional, invigilated, closed book exams (ICBE) resulting in research and…

Conventional team-based learning (TBL) uses a paper-based system to deliver a team-quiz component of the instructional method. We observed the use of this paper-based system in various settings and identified it could be challenging in a large classroom. Challenges include distributing paper answer cards, time to grade them, and additional…

The COVID-19 pandemic has accelerated the shift toward online learning solutions necessitating the need for developing online assessment solutions. Vendors offer online assessment delivery systems with varying security levels designed to minimize unauthorized behaviors. Combating cheating and securing assessment content, however, is not solely the…

The use of computerized adaptive testing algorithms for ranking items (e.g., college preferences, career choices) involves two major challenges: unacceptably high computation times (selecting from a large item pool with many dimensions) and biased results (enhanced preferences or intensified examinee responses because of repeated statements across…

The purpose of this study was to compare the quality of multiple choice questions (MCQs) developed using automated item generation (AIG) versus traditional methods, as judged by a panel of experts. The quality of MCQs developed using two methods (i.e., AIG or traditional) was evaluated by a panel of content experts in a blinded study. Participants…

The purpose of this study is to reduce ethics violations such as tricking and cheating that may occur in the offline assessment of undergraduate level Physics-II (Electricity) course subjects. The study is significant for the reliable and ethical evaluation of the Internet and computer-based educational process. Thirty-eight pre-service teachers…

This research explored the effect of incentives to complete online quizzes during a course. When a 1% weighting incentive per quiz was removed, student engagement dropped dramatically. There is also evidence that students who continued to complete quizzes did so with less vigour, spending less time on each quiz, starting them later in the week and…

In this study, we applied natural language processing (NLP) techniques, within an educational environment, to evaluate their usefulness for automated assessment of students' conceptual understanding from their short answer responses. Assessing understanding provides insight into and feedback on students' conceptual understanding, which is often…

With the effect of the pandemic, higher education is maintained all over the world with the help of online education methods. How to make online exams, which are an important part of distance education processes, in a way to prevent cheating and illegal behavior is an important issue that brings with it discussions. This research, in which the…

Purpose: The purpose of this case study is to share the authors' involvement and observation in adopting online exam as an evaluation tool, in the hope that others may too be able to adapt and circumvent this lockdown period while bringing a more reliable methodological approach in an online exam. Design/methodology/approach: This is a case study…

The COVID-19 shutdown of in-person university classrooms in Spring 2020 brought the question of how to conduct online examinations into urgent focus. Although, online education has been around since 1984 and online exams have been routinely built into online course syllabi, the mid-semester transition to online teaching confronted many instructors…

Machine learning (ML) has been increasingly employed in science assessment to facilitate automatic scoring efforts, although with varying degrees of success (i.e., magnitudes of machine-human score agreements [MHAs]). Little work has empirically examined the factors that impact MHA disparities in this growing field, thus constraining the…