VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

The role of context in cloze tests has long been seen as both a benefit as well as a complication in their usefulness as a measure of second language comprehension (Brown, 2013). Passage cohesion, in particular, would seem to have a relevant and important effect on the degree to which cloze items function and the interpretability of performances…

The present study aims to verify the impact of dynamic aids on learning L2 prepositions in relation to individual learner variables. Situated within the cognitive linguistics (CL) framework and differing from previous research, the present study hypothesizes that dynamic (animated) aids are not equally effective for all learners; rather, their…

Cloze tests have been the subject of numerous studies regarding their function and use in both first language and second language contexts (e.g., Jonz & Oller, 1994; Watanabe & Koyama, 2008). From a validity standpoint, one area of investigation has been the extent to which cloze tests measure reading ability beyond the sentence level.…

This study investigates the effects of cognacy on vocabulary learning. The research expands on earlier designs by measuring learning of English-Japanese cognates with both decontextualized and contextualized tests, scoring responses at two levels of sensitivity, and examining learning in a more ecologically valid setting. The results indicated…

This study examines common claims associated with shadowing. Studies in Japan conclude that shadowing is effective for improving learners' listening skills. Two common claims are that shadowing is effective for lower-proficiency learners and that it enhances learners' phoneme perception, thus improving listening comprehension skills. The former…

Previous research has shown a link between speaking fluently and using multiword expressions. However, evidence on how to effectively teach multiword expressions is limited. This study investigates the effect of fluency-oriented classroom teaching on speaking fluency, with special attention to multiword expressions. In this quasi-experimental…

This preliminary study examined the effect of proficiency and study abroad experience on L2 learners' ability to produce routines. Participants were 64 Japanese students in an English-medium university in Japan. They were divided into three groups: Group 1 had lower proficiency with no study abroad experience, Group 2 had higher proficiency but no…

Examined effects of item characteristics on cloze text performance. Focus was on the relationship between cloze item characteristics and scoring methods. Item characteristics examined were: content/function words; parts of speech; word frequency; number of occurrences of a word in text; alternative answers; syntactic variation; amount of content;…

This paper traces developments in educational psychology and measurement that led to the Test of English as a Foreign Language (TOEFL) and the test of English for International Communication (TOEIC) and the application of educational measurement terms such as validity and reliability to testing. Use of a table of specifications for planning…

Papers on second language testing in Japan include: "Differences Between Norm-Referenced and Criterion-Referenced Tests" (James Dean Brown); "Criterion-Referenced Test Construction and Evaluation" (Dale T. Griffe); "Behavioral Learning Objectives as an Evaluation Tool" (Judith A. Johnson); "Developing Norm-…