During the coronavirus disease-2019 (COVID-19) pandemic, many universities have adopted online exam proctoring technologies to monitor and control an increasing number of student cheating incidents. Although it looks like a natural and effective solution for a fair assessment of student online learning performance, the authors argue that…

The Human Resources Development Service of Korea developed a digital exam for five representative engineering categories and conducted a pilot study comparing the findings with the paper-and-pencil exam results from the last three years. This study aimed to compare the test efficiency between digital and paper-and-pencil examinations. A digital…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

Over the last five years, tremendous strides have been made in advancing the AIG methodology required to produce items in diverse content areas. However, the one content area where enormous problems remain unsolved is language arts, generally, and reading comprehension, more specifically. While reading comprehension test items can be created using…

IEA's International Computer and Information Literacy Study (ICILS) 2018 is designed to assess how well students are prepared for study, work, and life in a digital world. The study measures international differences in students' computer and information literacy (CIL): their ability to use computers to investigate, create, participate, and…

Student learning is increasingly taking place in digital environments both within and outside schooling contexts. Educational assessments are following suit, both to take advantage of the conveniences and opportunities that digital environments provide as well as to reflect the mediums of learning increasingly taking place in societies around the…

This book presents how to keep working on education in contexts of crisis, such as emergencies, zones of conflict, wars and health pandemics such as COVID-19. Specifically, this work shows a number of strategies to support global learning and teaching in online settings. Particularly, it first presents how to facilitate knowledge sharing and…

The recent interests in research in the assessment field have been rapidly shifting from decision-maker-centered assessments to learner-centered assessments (i.e., diagnostic and/or formative assessments). In particular, it is a very important research topic in this field to analyze how these learner-centered assessments are developed more…

IEA's International Computer and Information Literacy Study (ICILS) 2018 investigated how well students are prepared for study, work, and life in a digital world. ICILS 2018 measured international differences in students' computer and information literacy (CIL): their ability to use computers to investigate, create, participate, and communicate at…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

Approximately a third of the Programme for International Student Assessment (PISA) items in the core domains (math, reading, and science) are constructed-response items and require human coding (scoring). This process is time-consuming, expensive, and prone to error as often (a) humans code inconsistently, and (b) coding reliability in…

In this Forum article, Komatsu and Rappleye report that the results of PISA 2015 released December 2016 revealed a major oddity: reading scores in several of the "leading" East Asian countries had apparently plummeted. An interesting point is that Japan, Taiwan, Korea and Hong Kong are among the most advanced technological societies in…

Notable mean score differences for the "e-rater"® automated scoring engine and for humans for essays from certain demographic groups were observed for the "GRE"® General Test in use before the major revision of 2012, called rGRE. The use of e-rater as a check-score model with discrepancy thresholds prevented an adverse impact…

The use of computer-based assessments makes the collection of detailed data that capture examinees' progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies,…

This paper aims to clarify certain causes of the apparent reluctance of some classroom teachers to assist students to learn through the use computers. The main emphasis will be on primary school teaching, but it will be argued that the same, or similar, issues affect teachers at secondary and tertiary levels. It should be noted that the focus is…