Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

This study evaluated the validity of the Michigan English Test (MET) Listening Section by investigating its underlying factor structure and the replicability of its factor structure across multiple test forms. Data from 3255 test takers across four forms of the MET Listening Section were used. To investigate the factor structure, each form was…

Recently, research in second language acquisition has seen an increased attention on low-educated low-literate (LESLLA) learners. However, few of the existing instruments to measure L2 proficiency have been validated for use with this population. In this paper, we examine how adult L2 learners with diverging educational backgrounds perform on and…

Existing methods used to validate self-report questionnaires in foreign language teaching effectiveness have relied on Classical Test Theory (CTT). However, the use of CTT approaches limits the reliability and validity of self-report instruments. The Rasch Model, which is based on the principles of objective measurement, addresses some of the…

This article aims to introduce shame and guilt from social psychology into second language acquisition (SLA), to validate their psychometric measurement, and to examine their effects on second language (L2) learners' motivation and language achievements. In Study 1, the prevalence of shame and guilt reactions in L2 settings was explored. Moreover,…

This article aims at proposing a new measurement to assess the effects of language learners' goal-setting behavior, as an alternative to the traditional open-ended questionnaire. This goal-setting instrument was carefully developed through three phases. In the first phase, an item pool was generated. In the second phase, a pilot study was carried…

This study illustrates the use of score equity assessment (SEA) for evaluating the fairness of reported test scores from assessments intended for test takers from diverse cultural, linguistic, and educational backgrounds, using a workplace English proficiency test. Subgroups were defined by test-taker background characteristics that research has…

An increased enthusiasm on teacher accountability, in recent times, has led policy makers and teachers to a significant care over evaluating teachers' success. To this aim, a 40-item Teacher Success questionnaire was developed and validated by the application of the Rasch model. The Rasch model is used to decide whether the scores of an instrument…

A few computer-assisted language learning (CALL) instruments have been developed in Iran to measure EFL (English as a foreign language) learners' attitude toward CALL. However, these instruments have no solid validity argument and accordingly would be unable to provide a reliable measurement of attitude. The present study aimed to develop a CALL…

Since the last "TESOL Quarterly" commemorative issue 15 years ago, there have been too many important developments in language testing and assessment for all of them to be discussed in a single article. Therefore, this article focuses on issues that we believe are integrally linked to pedagogic and curriculum concerns of English language teaching.…