This study aims to examine whether differences exist in the factors influencing the difficulty of scoring English summaries and determining scores based on the raters' attributes, and to collect candid opinions, considerations, and tentative suggestions for future improvements to the analytic rubric of summary writing for English learners. In this…

The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…

Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

This qualitative study investigated the washback of performance-based assessment used by three English language teachers in Hokkaido, Japan, each of whom implemented their own course-specific assessments. The study employed qualitative research of an in-depth interview with 15 students and a self-reflective method from 3 teachers. Teachers…

This study investigates how implicit and explicit learning and knowledge are associated, by focusing on the salience of target form--meaning connections. The participants were engaged in incidental learning of artificial determiner systems that included grammatical rules of [± plural] (a taught rule), [± actor] (a more salient hidden rule), and [±…

The present study examined whether oral interactive (pair) rehearsals and individual rehearsals promote second language (L2) learners' communication ability. The participants were 60 first-year students from two required English classes at a national university in Japan. One class was designated as 'the compulsory rehearsal' group (CR, n=28); the…

Vocableveltest.org is a testing platform on which users can create on- line self-marking meaning-recall (reading or listening) and form-recall (typing) tests that address a number of limitations of the existing vocabulary level tests and vocabulary size tests. A major limitation of many existing vocabulary tests is the written receptive…

Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

This pilot study utilizes 360° camera and viewer technology in a science content-based EFL class at a Japanese University. Due to a lack of initial knowledge on how to best incorporate this technology into a content driven EFL class, a co-development strategy was devised between the teacher and students to dynamically design a course over…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

Background: In our research project, we have developed a scoring rubric for a second language (L2) summary writing for English as a foreign language (EFL) students in Japanese universities. This study aimed to examine the applicability of our five-dimensional rubric, which features both analytic and holistic assessments, to classrooms in the EFL…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

This mixed-methods study explored the effects of employing a genre-based approach (GBA) to descriptive report writing on the understanding of text structure and ideational, interpersonal and textual meanings among Japanese university students of English as a Foreign Language (EFL) over a 15-week course divided into three units. Applied within a…

The primary purpose of the Test of English for International Communication (TOEIC®) is to measure the everyday English skills of individuals, who speak a first language other than English, working in an international environment (ETS, 2015a, 2016a; Powers & Powers, 2015). The TOEIC also has six secondary purposes: (1) to verify the current…