Over the last decade, teachers in France have been increasingly pressured to use digital learning environments, and to shift from grade-based to skill-based assessment. Educational dashboards, which measure student input electronically, could foster such a transition by providing insights into learners' performances. However, such dashboards could…

Artificial intelligence (AI) has gained massive interest with the public release of the conversational AI "ChatGPT," but it also has become a matter of concern for academia as it can easily be misused. We performed a quantitative evaluation of the performance of ChatGPT on a medical physiology university examination. Forty-one answers…

During this digital era, France, like many other countries, is undergoing a transition from paper-based assessments to digital assessments in education. There is a rising interest in technology-enhanced items which offer innovative ways to assess traditional competencies, as well as addressing problem solving skills, specifically in mathematics.…

Teaching physiology can be challenging as students are initially required to understand basic and abstract concepts. Thus students typically view physiology as a "difficult" subject and place an emphasis on rote learning and memorization. Here, we attempted to address this knowledge gap by introducing a pedagogical intervention into the…

Log files from computer-based assessment can help better understand respondents' behaviours and cognitive strategies. Analysis of timing information from Programme for the International Assessment of Adult Competencies (PIAAC) reveals large differences in the time participants take to answer assessment items, as well as large country differences…

The aim of this study is to propose advantages provided by computerized tools when assessing reading ability. A new computer-based reading assessment evaluating both word reading and reading comprehension processes was administered to 687 children in primary (N=400) and secondary (N=287) schools. Accuracy (weighted scores) and speed of access…

IEA's International Computer and Information Literacy Study (ICILS) 2018 is designed to assess how well students are prepared for study, work, and life in a digital world. The study measures international differences in students' computer and information literacy (CIL): their ability to use computers to investigate, create, participate, and…

This study investigates whether re-thinking the separation of lexis and grammar in language testing could lead to more valid inferences about proficiency across modes. As argued by Römer, typical scoring rubrics ignore important information about proficiency encoded at the lexis-grammar interface, in particular how the co-selection of lexical and…

For many years, French and Canadian schools have welcomed students from around the world. This article presents the Binogi/ESCAPE project, which supports the integration of a multilingual digital resource in the classroom that presents STEM content through a multilingual lens with associated animated videos and quizzes. The study aims to encourage…

Assessing job applicants' general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in…

IEA's International Computer and Information Literacy Study (ICILS) 2018 investigated how well students are prepared for study, work, and life in a digital world. ICILS 2018 measured international differences in students' computer and information literacy (CIL): their ability to use computers to investigate, create, participate, and communicate at…

Recent research investigating embedded stem priming effects with the masked priming paradigm and pseudoword primes (e.g., "quickify"--"quick") has shown that priming effects can be obtained even when the embedded target word is followed by a non-morphological ending (e.g., "quickald"--"quick"). Here we…

Since 2012 an interdisciplinary and culturally heterogeneous team composed of more than 30 people has been engaged in the complex process of conceiving, designing and validating an online placement test with formative orientation called SELF (Système d'Evaluation en Langues à visée Formative), developed and already deployed in six different…

The goal of the experiment was to examine the relevance of a new French web-based assessment, Tinfolec (Test INFOrmatisé d'évaluation de la LECture), the aim of which is to evaluate the reading abilities of children in primary grades. The participants were 1,016 children from Grades 2 to 5. They completed the five tasks of Tinfolec designed to…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…