A key role of universities is the credentialing of student learning by awarding degrees and diplomas. This requires universities to have confidence in the integrity of their assessment processes and in turn, external stakeholders to have the same confidence. This study investigates the following research question: 'Has COVID-19 had an impact on…

Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the…

We investigated the ecological validity of performance measures from a computer-based assessment tool that utilises scripted video vignettes. The intended purpose of this tool is to assess the maintenance and repair skills of automotive technician apprentices, complementing traditional hands-on assessment formats from the German journeymen's…

This research presents a novel reading fluency (rf) measurement formula that accounts for both reading rate and comprehension. Possible formulas were investigated with 68 participants in a strategic reading course in an IEP at a small Pacific Island university. The selected formula's scores demonstrated concurrent validity through strong…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

Online quizzes and learning platforms provided by textbook publishers have become common components of undergraduate education. Here, I examine how participation in these formative assessments related to student course performance. Over multiple semesters, students completed either free online unlimited attempt quizzes or assignments from a…

The role of artificial intelligence (AI) in education plays a crucial role in teacher training digitalisation. Although AI has enormous potential, not much is known about how pre-service teachers perceive and utilise AI tools in professional practice. Hence, this study, guided by the Unified Theory of Acceptance and Use of Technology framework,…

Purpose: The aim of the study is to examine the intention of students toward the online education system with emphasis on online examination in higher education. The study investigated different constructs that have an influence on the use of the online platform for learning to the specific domain that mitigates the personal needs of the learners…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

In this classroom note, we outline a system of assessment used by the authors since 2020 to deliver individualized summative assessments to students from first- and second-year mathematics courses. Our system comprises three modular components allowing a mix-and-match of different technological approaches and mathematical question types. First is…

In this study, we investigated effects of morphological processing on handwriting production in beginning writers of German. Children from Grades 3 and 4 were asked to copy words from a computer screen onto a pen tablet, while we recorded their handwriting with high spatiotemporal resolution. Words involved a syllable-congruent visual disruption…

We report on an innovative computer-adaptive assessment, the Comprehensive Research-based Early Math Ability Test (CREMAT), using the case of 1st- and 2nd-graders' understanding of geometric measurement. CREMAT was developed with multiple aims in mind, including: (1) be administered with a reasonable number of items, (2) identify the level(s) of…

While most research on scalar implicature has focused on the lexical scale "some" vs "all," here we investigated an understudied scale formed by two syntactic constructions: categorizations (e.g., "Wilma is a nurse") and comparisons ("Wilma is like a nurse"). An experimental study by Rubio-Fernandez et al.…

We aimed to develop an item bank of computerized adaptive testing for eating disorders (CAT-ED) in Chinese university students to increase measurement precision and improve test efficiency. A total of 1,025 Chinese undergraduate respondents answered a series of questions about eating disorders in a paper-pencil test. A total of 133 items from four…

Background and Context: Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and…