This study aimed to propose a new method for scoring C-Tests as measures of general language proficiency. In this approach, the unit of analysis is sentences rather than gaps or passages. That is, the gaps correctly reformulated in each sentence were aggregated as sentence score, and then each sentence was entered into the analysis as a polytomous…

The Hanyu Shuiping Kaoshi (HSK) is a multi-level, multi-purpose Chinese proficiency test developed by the Center for Language Education and Cooperation (previously the Office of Chinese Language Council International and, henceforth, referred to by its colloquial name "Hanban"). It assesses reading, writing, and listening skills of…

The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

This report presents an overview of the "SpeechRater"? automated scoring engine model building and evaluation process for several item types with a focus on a low-English-proficiency test-taker population. We discuss each stage of speech scoring, including automatic speech recognition, filtering models for nonscorable responses, and…

This article compares Spanish proficiency assessments across three states (Texas, Arizona, and California) in relation to four overarching themes: (a) verification methods of proficiency; (b) test-task authenticity; (c) impact of pedagogical content knowledge in test performance; and (d) conceptions of language 'correctness' on the scoring…

Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

In Dynamic Assessment (DA), the observation that individuals respond differently to support, or mediation, is important for diagnoses of development. The concept of learning potential refers to openness to mediation, i.e., the extent of change to performance when mediation is available, which may suggest learners will need less overall instruction…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

Over several decades, numerous approaches applied to EFL have resulted in theories and reasonings to teach and learn English. Although Communicative Language Teaching (CLT) is the most commonly used path nowadays, it has only resulted in minimal development of university learners' oral skills; i.e., English-beginner-level students usually attain…

Recent advances in machine learning have made automated scoring of learner speech widespread, and yet validation research that provides support for applying automated scoring technology to assessment is still in its infancy. Both the educational measurement and language assessment communities have called for greater transparency in describing…

Owing to the plethora of user-friendly audio/video creation and editing applications as well as free full-featured hosting platforms, videoing and sharing has become a lifestyle of today's students. Utilizing these spontaneous practices, the current study examined the effects of digital media assignments (DMAs) and accompanying asynchronous…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

This paper utilizes a case-study design to discuss global aspects of massive open online course (MOOC) assessment. Drawing from the literature on open-course models and linguistic gatekeeping in education, we position freeform assessment in MOOCs as both challenging and valuable, with an emphasis on current practices and student resources. We…

This mixed-methods study explored the effects of employing a genre-based approach (GBA) to descriptive report writing on the understanding of text structure and ideational, interpersonal and textual meanings among Japanese university students of English as a Foreign Language (EFL) over a 15-week course divided into three units. Applied within a…

This paper focuses on examining the use of the Duolingo App as a supplement to the traditional ESP courses in Secretarial Studies, for Advanced ESP learners Classes of Lycée Technique et Professional de Porto Novo (LTP-PN), in the Benin Republic. The Objective is to assess substantial improvement of Learners Oral Communication skills after 3…