Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

Drawing on a growing body of research on the interface between corpus linguistics and second/foreign language testing and assessment, we adopted "Peykare," a large-scale, annotated, Persian written language resource to evaluate the content (i.e., coverage and typicality) and construct validity of a Persian language proficiency test…

This study discusses the characteristics of test specifications (specs) and item writer guidelines (IWGs), their role in item development of English as a Second Language (ESL) reading tests, and the use of the CEFR for specs development. This mixed-method study analyzed specs, IWGs, tests, and the Pearson Test of English General test statistics.…

Although fairness in assessment practices has gained noticeable attention over the recent years, there has been a long-lasting study to design and validate a questionnaire to measure it from a psychometric perspective. Thus, this study aims to develop and validate a questionnaire with adequate psychometric properties to measure fairness in…

Teacher agency as an influential factor in teacher professionalism has recently gained global inquiry in the EFL context. However, no valid instrument has ever been designed to evaluate EFL teachers' ecological agency. This gap prompted the researchers of the current study to develop and validate a questionnaire to assess EFL teachers' ecological…

The Listening Vocabulary Levels Test (LVLT) created by McLean et al. Language Teaching Research 19:741-760, 2015 filled an important gap in the field of second language assessment by introducing an instrument for the measurement of phonological vocabulary knowledge. However, few attempts have been made to provide further validity evidence for the…

Teacher support, as an essential type of social support and an important antecedent of many key outcomes in L2 learning, can significantly contribute to foreign language achievement. Although teacher support has received considerable attention in education and educational psychology, it has drawn scanty attention in foreign language and applied…

Teacher agency is a pivotal element of professionalism and second/foreign language (L2) education. However, its role in L2 assessment has remained under-researched. Part of this negligence is due to the absence of a validated questionnaire to measure the construct and its underlying components. To address this gap, drawing on the ecological…

Smartphones and the literacy to harness the educational affordances of photographs currently rest on the bedrock of second language (L2) education. Building on social semiotic theory, this study developed and validated a visual literacy scale for smartphone photography (VLS4SP). Despite the importance of visuals and smartphones, no valid scale is…

Many Chinese universities are implementing an educational reform to transform their general English courses into academic English courses. Accordingly, how to assess students' English ability should also be reformed. In this test review, we introduce a school-based general academic English summative test developed by English instructors. An…

As testing involves various aspects of education as well as the ones who are involved like instructors, students, managers, teacher trainers, testers, and decision-makers, it comes to be highly crucial to develop ethical tests. In addition, as some methods of testing are more favored and practiced compared to others without considering the ethical…

The idea of sources other than the test-takers' knowledge leading to different results on high-stakes tests was the motif based on which the present investigation was initiated on the probable sources of unreliability of a test. For this purpose, the researchers went through a thorough literature review with the aim to identify the issues to be…

Pearson Test of English Academic (PTE Academic), a high-stakes English language proficiency test, underwent substantial revisions in 2021. The test duration was reduced from 3 h to 2 h by reducing specific task numbers and sections. This study investigates the impact of these changes on teachers' perceptions and teaching practices, areas…

Addressing the lack of English tests that measure critical thinking (CT) abilities of EFL learners, this study aims to develop an English Critical Thinking Test (ECTT) designed to measure the consistency, analysis, and inference CT skills. It is a follow-up to a pilot study to accumulate validity evidence for the use of the ECTT. A total of 262…

Thinking has always been an integral part of human life, and it can be said that whenever humanity has been thinking, it has been practicing a kind of criticizing the issues around. This is the concept of critical thinking that enhances the ability of individuals to identify problems and find solutions. Most previous research has focused on only…