Language testing research has suggested that placement accuracy can be an important factor in the consequences of placement decision-making. However, previous studies primarily have used a one-shot teacher judgment of placement accuracy, suffering from a lack of students' perspectives of their time-varying experiences. The present study aimed to…

The purpose of this study was to pursue an enhanced understanding of teacher assessment literacy by investigating tertiary EFL practitioners' assessment-related personal theories, conceptions and beliefs. The study was based on sociocultural theory as a theoretical framework and informed by interpretivism philosophical underpinnings. Twelve…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…

In the US K-12 public school settings, each state's annual English language proficiency (ELP) assessment, as part of an educational accountability system, has tremendous impact on English learner (EL) students' academic paths and success. It is thus critical to establish a robust validation framework and empirical evidence to ensure that states'…

It is widely believed that human rating performance is influenced by an array of different factors. Among these, rater-related variables such as experience, language background, perceptions, and attitudes have been mentioned. One of the important rater-related factors is the way the raters interact with the rating scales. In particular, how raters…

This explanatory sequential mixed methods study aimed at exploring the grading decision-making of Iranian English language teachers in terms of the factors used when assigning grades and the rationales behind using those factors. In the preliminary quantitative phase, a questionnaire was issued to 300 secondary school and private institute EFL…

Background: Variations in the skill profiles of learners have become an important research area in recent years. However, there is a lack of empirical research on this topic in Japan. We conducted three studies to address this gap. Methods: Study 1 investigated the characteristics of the flat and uneven skill profiles of Japanese learners of…

The study investigated the alignment process of the International English Language Competency Assessment (IELCA) suite examinations' four levels, B1, B2, C1 and C2, onto the Common European Framework of Reference (CEFR) by explaining and discussing the five linking stages (Council of Europe (CoE 2009). Unlike previous studies, this study used the…

Background: A strong interest in researching World Englishes (WE) in relation to language assessment has become an emerging theme in language assessment studies over the past two decades. While research on WE has highlighted the status, function, and legitimacy of varieties of English language, it remains unclear how raters respond to the results…

English teachers' assessment literacy has always been considered as an important factor in their performance. However, no instrument has ever been developed to assess this construct among Iranian EFL teachers. To fill this gap, in the first phase of the present study, a theoretical framework for the main four components of teacher assessment…

Background: This study aims to develop a test for assessing pragmatic comprehension ability in Chinese as a second language (L2). Following the framework of an argument-based approach to test validation, this study attempts to obtain backing for the Evaluation and Explanation inferences. Methods: Test items were developed based on two sources of…

Background: A project has recently been proposed by the National Education Examinations Authority, P. R. China, to develop a national framework of reference for English language education, provisionally called China Standards of English (CSE). In this article, we argue for the necessity of developing the framework of reference in China and…

The statistical analysis technique of correlation has extensively been used in second/foreign language testing research for a variety of purposes. Most commonly, the technique has been used to validate newly constructed language tests (particularly cloze tests) against previous supposedly valid measures. Tests such validated are meant to…