The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a…

Despite the increased research interest on the implementation of Open Book Open Web exams in developed countries, there has been very little systematic studies that investigated the difference in gender experience and the cognitive process that could affect attitude towards OBOW exams compared to the traditional ones in developing countries. This…

Scientific inquiry ability is closely related to the process of hands-on inquiry practice. However, its assessment is often separated from this practice due to the limitation of technical basis and labor cost. The development of multimodal data analysis provides a new opportunity to realize automated assessment based on hands-on practice.…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

Technology, constantly present in current society and education, needs to make use of the most effective digital resources to optimize the teaching-learning process. Despite the growing body of literature on the pedagogical effectiveness of digital resources in a second language (L2) context, limited research has been conducted when working with…

The COVID-19 pandemic has led to rapid change, unprecedented in higher education. One such change has been the almost complete shift to online assessment. The simultaneous employment of online assessment and proctoring has not enjoyed the rigorous academic debate and research traditionally associated with such shifts in academia. This engagement…

School readiness is recognized as one of the key starting points for children's further success in their school work and in their subsequent career. However, many kindergarten teachers still miss and long for a comprehensive, reliable and standardized diagnostic tool which could help them recognize the level of children's school readiness. That is…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs' test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible…

The global pandemic has forced all language teachers, regardless of their affinity to and preparation for online teaching, to convert their face-to-face courses into online versions of crisis teaching. Despite being a crisis, it has also opened opportunities for language educators and researchers to identify innovative ways of evaluating,…

The present study investigates the efficacy of preparation time in four speaking tasks of TOEFL iBT. As the current pre-task planning time offered by ETS is very short, 15 to 30 seconds, we intended to explore how the test-takers' speaking quality would change if the preparation time was added to the response time, giving the respondents a…

This study investigated the assessment literacy of teachers of English as a Foreign Language in postsecondary education in Oman. Using self-assessment questionnaires, it examined teachers' assessment competencies and practices and digital assessment literacy. Multivariate and correlation analyses tested the effects of gender, age, pre-service and…

Healthcare educators are encouraged to provide both skill-based practical exams and interprofessional experiences to prepare students for clinical practice. With skill-based exams come increased student stress and anxiety. This article reports on the development, exploratory outcomes, and lessons learned from an ungraded objective structured…

The purpose of this study is to examine the impact of artificial intelligence (AI) on online assessment in the context of opportunities and threats based on the literature. To this end, 19 articles related to the AI tool ChatGPT and online assessment were analysed through rapid literature review. In the content analysis, the themes of "AI's…

This dissertation focuses on three manuscripts all related to bolstering science achievement through recommendations from the National Research Council (NRC) regarding the teaching and learning of science. The manuscripts address meeting the NRC's call to incorporate curriculum and assessment that lead to more in-depth knowledge that can be…