This study evaluated the validity of the Michigan English Test (MET) Listening Section by investigating its underlying factor structure and the replicability of its factor structure across multiple test forms. Data from 3255 test takers across four forms of the MET Listening Section were used. To investigate the factor structure, each form was…

We used a data set with n = 1,603 learners of foreign languages (FL) to develop and validate the short form of the Foreign Language Enjoyment Scale (S-FLES). The data was split into 2 groups, and we used the first sample to develop the short-form measure. A 3-factor hierarchical model of foreign language enjoyment (FLE) was uncovered, with FLE as…

Background: A critical issue in International English Language Testing System (IELTS) lies in the significance of the validity of IELTS listening comprehension test (hereafter IELTS LCM). However IELTS listening validity has been investigated, it has not been investigated with reference to multiple sources of evidence regarding item internal…

One way to promote autonomy in the second language can be through the use of Self-access Centres (SACs). These are spaces for students to engage in activities such as self-study or communication with other learners, or native-speakers of the target language. However, merely having these spaces available does not guarantee that students will use…

This study aims to develop and validate a willingness to listen (WTL) scale for second language (L2) contexts. There are several studies on willingness to communicate (WTC) in L2. However, most of these studies are based on the speaking dimension of communication. As an ignored dimension, listening in L2 is underestimated in WTC research. The…

This study assessed the factor structure of the Test of English for International Communication (TOEIC®) Listening and Reading test, and its invariance across subgroups of test-takers. The subgroups were defined by (a) gender, (b) age, (c) employment status, (d) time spent studying English, and (e) having lived in a country where English is the…

Foreign language anxiety (FLA), which constitutes a serious problem in the foreign language learning process, has been mainly seen as a research issue regarding adult language learners, while it has been overlooked in children. This is because there is no an appropriate tool to measure FLA among children, whereas there are many studies on the…

The first aim of this study was to develop a computer adaptive EFL test (CALT) that assesses test takers' listening and reading proficiency in English with dichotomous items and polytomous testlets. We reported in detail on the development of the CALT, including item banking, determination of suitable item response theory (IRT) models for item…

This study examined the construct validity of the TOEFL iBT Speaking subsection for the purposes of international teaching assistant (ITA) certification, a purpose for which it was not specifically designed. The factor structure of the new TOEFL was compared with that of another language performance test in use at a major American research…

In this article, I specify a conceptual framework for test validity research on content assessments taken by English language learners (ELLs) in U.S. schools in grades K-12. This framework is modeled after one previously delineated by Willingham et al. (1988), which was developed to guide research on students with disabilities. In this framework…

This study assessed the invariance in the factor structure of the "Test of English as a Foreign Language"™ Internet-based test (TOEFL® iBT) across subgroups of test takers who differed in native language and exposure to the English language. The subgroups were defined by (a) Indo-European and Non-Indo-European language family, (b)…

What C-tests actually measure has been an issue of debate for many years. In the present research, the authors examined the hypothesis that C-tests measure general language proficiency. A total of 843 participants from four independent samples took a German C-test along with the TestDaF (Test of German as a Foreign Language). Rasch measurement…

The validity and reliability of a scale measuring attitudes toward foreign language were studied with 536 high school seniors. Results of principal components analysis identified five interpretable dimensions and suggested the need to improve the internal structure of the measure. (SLD)