Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…

The present investigation explores Cognitive Test Anxiety (CTA) in a high-stake oral examination, taking into consideration how face-to-face and computer-based examination formats affect test-takers' anxiety and consequently language performance. Two speaking tests -- face-to-face and computer-based -- were developed for a Spanish university's…

An effective diagnostic test can play a key role in language learning, allowing strengths and weaknesses in students' linguistic development to be identified and addressed. This paper describes the online Cambridge English diagnostic test, assessing English grammatical knowledge at A2 level. As most language tests focus on proficiency or…

Log files from computer-based assessment can help better understand respondents' behaviours and cognitive strategies. Analysis of timing information from Programme for the International Assessment of Adult Competencies (PIAAC) reveals large differences in the time participants take to answer assessment items, as well as large country differences…

Despite the increasing importance of language testing, technology design matters related to testing have hardly been addressed in academic research, yet not enough has been written on test-taking anxiety related to computerized speaking tests. Although students nowadays are digital natives, in our experience they seem to experience a significant…

The present retrospective, descriptive, and quasi-experimental study aimed to explore students' perceptions of traditional teaching combined with gamified and nongamified e-tests for postlecture reinforcement. Midterm knowledge retention and academic performance were also analyzed. The study was conducted from February 2021 to May 2022, involving…

This study sheds light on the relation between assessment modalities and student behavior through linguistics styles, and academic performance. First, we examine the effect of assessment modalities (self-evaluation quizzes and summative quizzes) on academic performance. Using two modalities of online quizzes, we mainly focus on the student…

The advent of artificial intelligence (AI) technologies heralds a transformative era in education. This study investigates the integration of AI tools in developing educational assessment rubrics within the 'Curriculum Design Development and Evaluation' course at the University of A Coruña during the 2023-2024 academic year. Employing an…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

Assessing speaking is one of the most difficult tasks in computer based language testing. Many countries all over the world face the need to implement standardized language tests where speaking tasks are commonly included. However, a number of problems make them rather impractical such as the costs, the personnel involved, the length of time for…

This paper discusses the results of a study conducted with 218 students in the final year of high school to determine their opinions about the feasibility of using a tablet PC for delivery of a standardized English language test. One such test could be the English paper of the exam given to students upon completion of the Baccalaureate program in…

The work at hand is part of a wider study the aim of which was to determine what kind of factors influence failures in pragmatic items of an online adaptive placement test taken by a group of 34 Spanish students in their first year at university. A preceding analysis (Carrió & Martín, 2016) showed the type of personal factors, such as lack of…

The World Health Organization (WHO) officially declared the novel coronavirus (COVID-19) as a pandemic on 11 March 2020, and educational institutions have had to modify most of their activities (face-to-face activities were suspended). This situation forced academic institutions to modify the evaluation format of students. The use of proctoring…

Over the few years, computer based language testing has become prevailing worldwide. The number of institutions the use computers as the main means of delivery has increased dramatically. Many students face each day tests for well-known high-stakes decisions which imply the knowledge and ability to use technology to provide evidence of language…

Background and Context: Despite many initiatives to develop Computational Thinking (CT), not much is known about how early programmers develop CT and how we can assess their learning. Objective: Determine if the analysis of students' interactions with an online platform allows understanding the development of CT, how we can convert data collected…