This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is…

In order to assess the accuracy and validity of proficiency diagnostic tests in Second Language (L2), specifically regarding the linguistic (orthographic, semantic, syntactic, lexical) and cognitive (verbal reasoning, lexical decision) components for the immigrant population in Portugal, a study of cut-off points of 6 tests was conducted. This…

Dictation is a traditional technique for both teaching and testing overall language ability and listening comprehension. In a dictation, a passage is read aloud by the teacher and examinees write down what they hear. Due to the peculiar form of dictations, psychometric analysis of dictations is challenging. In a dictation, there is no clear…

In contrast with the assumptions made in standard measurement models used in large-scale assessments, students' performance may change during the test administration. This change can be modeled as a function of item position in case of a test booklet design with item-order manipulations. The present study used an explanatory item response theory…

The increasing popularity of the Common European Framework of Reference (CEFR) in non-native English-speaking countries has generated a demand for concrete examples in the creation of CEFR-based tests that assess the four main English skills. In response, this research endeavors to provide insight into the development and validation of a…

This paper reports the findings of a study that investigated why a large number of test-takers show a low performance in four language skills (listening, speaking, reading, and writing) offered in an entry test used by a College of Technology in Oman to place students in advanced diploma and bachelor's degree programs. The main research question…

Need analysis is an essential element in the process of designing any language course as it seeks to cater for what learners need in their lessons. This study proposes a framework to analyse learners' needs for exam preparation courses. The proposed framework adopts the works of Macalister, Nation, and Brindley to address different linguistic and…

This study tests the role of verbal mediation during theory of mind processing in autism spectrum disorder (ASD). Adolescents with ASD or typical development completed a false belief task while simultaneously performing a verbal or nonverbal load task. There was no group difference in false belief "accuracy;" however, under verbal load,…

The ability of international graduates to grasp a foreign language has become increasingly important as the demand for English-speaking workers has grown worldwide. To this end, several strategies for encouraging the use of English in academic settings have been implemented. International students' academic success may suffer if colleges refuse to…

Background and aims: The purpose of the current exploratory study was to describe the inferential narrative comprehension skills of young school-age children on the autism spectrum who, as a group, are at high risk of significant and persistent reading comprehension difficulties. Our aim was to investigate whether the anticipated difficulties in…

Language testing means taking decisions: about the test taker's results, but also about the test construct and the measures taken in order to ensure quality. This article takes the German test "telc Deutsch C1 Hochschule" as an example to illustrate this decision-making process in an academic context. The test is used for university…

Purpose: The authors created a database of expository oral language samples with the aims of describing the nature of students' expository discourse and providing benchmark data for typically developing preteen and teenage students. Method: Using a favorite game or sport protocol, language samples were collected from 235 typically developing…

Compared with reading, writing and listening, there has been a paucity of empirical data documenting learners' experiences of speaking English as a second language (ESL) or English as a foreign language (EFL) in different learning contexts in spite of the fact that developing the ability to speak in a second or foreign language is widely…

Current assessment practices in the United States are not able to accurately capture the total linguistic, cognitive, and achievement abilities of bilingual learners. There are psychometric complexities involved when assessing and interpreting test results of bilingual students, which impact the validity of this practice. Further, the compromise…

This study examined initial evidence of changes in fit to a unidimensional model for some language tests at multiple ability levels. Seven data sets were analyzed using the first phase of exploratory factor analysis: principal component eigenvalue extraction. Each data set is analyzed at varying n-sizes: whole group; random subsample; and five…