Phonological processing of written characters has been recognized as a crucial element in acquiring literacy in any language, both native and foreign. This study aimed to assess Japanese primary school students' phoneme-grapheme recognition skills using both paper-based and touch-interface tests. Differences between the two test formats and the…

Many tertiary language courses have some online components as part of their blended learning initiatives. These online activities could be part of assessments, and online quizzes/tests can be used as preparation for the demanding final written examination. This study attempts to shed some light on the effects of online tests on final examination…

This study aimed to compare item characteristics and response time between stimulus conditions in computer-delivered listening tests. Listening materials had three variants: regular videos, frame-by-frame videos, and only audios without visuals. Participants were 228 Japanese high school students who were requested to complete one of nine…

Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

As a result of the Japanese Ministry of Education's recent edict that students' written and spoken English should be assessed in university entrance exams, there is an urgent need for tools to help teachers and students prepare for these exams. Although some commercial tools already exist, they are generally expensive and inflexible. To address…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

Email remains a key mode of communication between faculty and students in higher education institutions. Composing appropriate email texts is an important skill for learners; however, little technological support is available for the pragmatic aspect of email communication -- the ways in which social context influences language choices.…

Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can…

Background: Research on the test-taker perception of assessments has been conducted under the assumption that negative test-taker perception may influence test performance by decreasing test-taking motivation. This assumption, however, has not been verified in the field of language testing. Building on expectancy-value theory, this study explored…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

There are some English verbs that can be used both intransitively and transitively. Verbs such as "break," "close," and "melt" can appear in intransitive active, transitive active, and passive constructions. Although native English speakers know in what kind of context a target verb is used in a certain construction,…

This article reviews assessment practices of Japanese as a second language as taught in Japan since the 1980s. It begins with an explanation of the social and political conditions that have impacted assessment practices in Japan and then addresses current assessment practices and issues. This analysis first examines large-scale tests developed in…

This article investigates the relative effectiveness of online and paper-based formative assessment in the learning of English as a second language. For this study, 74 Japanese university second language (L2) students took online quizzes, while 71 were given paper-based quizzes to complete. The quiz content was drawn from learning material found…

Background: The use of computers has increased in speaking assessments; however, there are concerns about how the absence of an interlocutor affects performance on speaking tests. Method: In the current study, the test scores and the underlying factor structures of monologic tasks were compared between two delivery modes: computer delivery and…

This paper reports on the implementation of Japanese extensive reading with international students studying at a Japanese university using graded readers (GRs). GRs chosen for the present study were simplified versions of original Japanese literature and were used to support students in acquiring a top-down reading strategy, a wide range of…