The role of artificial intelligence (AI) in education plays a crucial role in teacher training digitalisation. Although AI has enormous potential, not much is known about how pre-service teachers perceive and utilise AI tools in professional practice. Hence, this study, guided by the Unified Theory of Acceptance and Use of Technology framework,…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

We developed the Scaffolding English E-assessment Learning (SEEL), where instant feedback and scaffolding hints were provided, to facilitate students to acquire the knowledge of English grammar. On the other hand, an empirical study was conducted to investigate how cognitive styles (i.e. Holists vs. Serialists) affected learners' reactions to the…

This study aimed to reveal the attitudes of the students who were subjected to measurement and evaluation in an online testing environment towards the computer based testing (CBT) platform and the factors that affect their attitudes. It also examined the students' cognitive loads in the exam designed with multimedia elements from message design…

While the potential of Dynamic Assessment (DA) and its variants (Computerized Dynamic Assessment (CDA) and Group Dynamic Assessment (GDA)) for EFL classrooms has been recognized, there is a lack of research on its practical implementation compared to the well-established field of Summative Assessment (SA). Thus, the objective of this qualitative…

Artificial intelligence (AI) and Intelligent Computer-Assisted Language Assessment (ICALA) are transforming the educational landscape by radically changing how lessons are taught and students are evaluated. As the masterminds behind the curriculum, it is critical to consider the emotional and mental health of teachers who applied ICALA as part of…

The University English Centres of Australia (UECA) 'Assessment Symposium: Assessment Practice in a Changing World' at Southern Cross University in October 2022 highlighted the growing interest in integrated assessment in Australian university direct entry programs (DEPs) for English as Additional Language (EAL) students. In keynote presentations,…

The contributions of Computerized Formative Assessment (CFA) to teachers' instructional practices and students' learning outcomes necessitate the development of valid and reliable instruments for measuring teachers' literacy. To address this necessity, this study adopted an exploratory sequential mixed-methods design via drawing on a dual…

Language assessment is increasingly computermediated. This development presents opportunities with new task formats and equally a need for renewed scrutiny of established conventions. Recent recommendations to increase integrated skills assessment in lecture comprehension tests is premised on empirical research that demonstrates enhanced construct…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

How can one construct a test that provides accurate measurements across the range of performance levels while providing adequate coverage of all of the critical areas of the domain, yet that is not unmanageably long? This paper discusses the approach taken in a linear test of academic English language, and how the transition to a computer-based…

The computer-based College English Test-Spoken English Test (CET-SET) in China incorporates interactional competence in its construct by using a non-face-to-face paired discussion task. To build validity arguments for this unique computer-mediated interactive task, the present study investigated the impact of delivery mode on test performance in…

While gamified technology integration in vocabulary instruction within a flipped classroom has yielded beneficial teaching outcomes, specific studies have raised concerns about potential adverse effects linked to this approach. As a result, conducting a comparative analysis between gamified technology and conventional paper-based methods within…

Over the last few years, technology has offered new ways of teaching and learning. Accordingly, educational systems are adopting what technology has purveyed to education. The abrupt upsurge of the COVID-19 pandemic also expedited this employment and impelled educational systems to shift to online teaching and learning. Consequently, the offline…

Readers should construct a coherent discourse during reading comprehension. The ability to build coherence has been examined using coherence and cohesion judgment tasks. Although eye-tracking studies have been conducted on building coherence or processing cohesion among native language users, few such studies have been conducted with second…