Machine learning (ML) is an emergent computerised technology that relies on algorithms built by 'learning' from training data rather than 'instruction', which holds great potential to revolutionise science assessment. This study systematically reviewed 49 articles regarding ML-based science assessment through a triangle framework with technical,…

With the widespread use of computers in modern assessment, online calibration has become increasingly popular as a way of replenishing an item pool. The present study discusses online calibration strategies for a joint model of responses and response times. The study proposes likelihood inference methods for item paramter estimation and evaluates…

While exam-style questions are a fundamental educational tool serving a variety of purposes, manual construction of questions is a complex process that requires training, experience, and resources. This, in turn, hinders and slows down the use of educational activities (e.g. providing practice questions) and new advances (e.g. adaptive testing)…

Purpose: The aim of the study is to examine the intention of students toward the online education system with emphasis on online examination in higher education. The study investigated different constructs that have an influence on the use of the online platform for learning to the specific domain that mitigates the personal needs of the learners…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

In this classroom note, we outline a system of assessment used by the authors since 2020 to deliver individualized summative assessments to students from first- and second-year mathematics courses. Our system comprises three modular components allowing a mix-and-match of different technological approaches and mathematical question types. First is…

In this study, we investigated effects of morphological processing on handwriting production in beginning writers of German. Children from Grades 3 and 4 were asked to copy words from a computer screen onto a pen tablet, while we recorded their handwriting with high spatiotemporal resolution. Words involved a syllable-congruent visual disruption…

We report on an innovative computer-adaptive assessment, the Comprehensive Research-based Early Math Ability Test (CREMAT), using the case of 1st- and 2nd-graders' understanding of geometric measurement. CREMAT was developed with multiple aims in mind, including: (1) be administered with a reasonable number of items, (2) identify the level(s) of…

While most research on scalar implicature has focused on the lexical scale "some" vs "all," here we investigated an understudied scale formed by two syntactic constructions: categorizations (e.g., "Wilma is a nurse") and comparisons ("Wilma is like a nurse"). An experimental study by Rubio-Fernandez et al.…

We aimed to develop an item bank of computerized adaptive testing for eating disorders (CAT-ED) in Chinese university students to increase measurement precision and improve test efficiency. A total of 1,025 Chinese undergraduate respondents answered a series of questions about eating disorders in a paper-pencil test. A total of 133 items from four…

Background and Context: Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and…

South Africa, like other countries in the world, went into lockdown due to the Coronavirus disease (COVID-19) which meant closure of venue-based exam centres, university libraries and academic offices for more than three months. This encounter forced higher institutions of learning to review and reconfigure their assessment practices and conduct…

This paper explores the effects of gamification (a game-based student response system) on student learning in the United Arab Emirates (UAE). The data, collected through a series of semi-structured in-depth interviews with 32 learners, were analyzed using qualitative thematic analysis (i.e., template analysis). Based on an in-depth analysis of the…

Although formative peer assessment (FPA) has become a prevailing learning activity in different educational settings, there are not enough suggestions on how to structure it with instructional supports in online environments to optimize its benefits. Therefore, this study aims to propose design guidelines for the development of an effective online…

COVID-19 caused substantial change in learning and teaching in higher education. In this article we explore how assessment changed in the initial semester of emergency remote teaching in an Australian university. Seventy academics responsible for courses (unit of study), representing a wide array of disciplines, completed an online survey at the…