Shifting focus of asocial language tests toward social considerations recalls their ideological basis (Mirhosseini, De Costa, 2020). The recurrent exposure to and involvement in discursive constructions of high stakes' contents, may bring along certain sociocultural conceptualizations and values by test audiences (van Dijk, 1998). Thus, unless a…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

Despite the popularity of the TOEIC in the Korean society for over 30 years, few studies have investigated the understanding and usage of TOEIC scores in the Korean context. This research gap needs to be filled to provide test users with useful information in the Korean context. Using an argument-based approach to validation, this study…

Proficiency in the English language has been described as central for determining Non-Native English Speaking Teachers (N-NESTs) selection for joining the profession. The Ministry of Education in the Sultanate of Oman decided to set the score of Band 6 on the International English Language Testing System (IELTS) for accepting the English Language…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

Speech acts are the major concern of interlanguage pragmatists. The present study aimed to 1) examine the reliability and validity of an interlanguage pragmatic (ILP) competence test on speech acts in a Chinese EFL context, and 2) investigate EFL learners' variations of ILP competence by language proficiency. Altogether 390 students participated…

Performing routines in interlanguage is vitally important for EFL learners since it can cause embarrassment between speakers from different cultures. The present study aims to 1) investigate the reliability and validity of an interlanguge pragmatic competence test on routines in a Chinese EFL context with multiple choice discourse completion task…

Computer technology made its way into writing instruction and assessment with spelling and grammar checkers decades ago, but more recently it has done so with automated essay evaluation (AEE) and diagnostic feedback. And although many programs and tools have been developed in the last decade, not enough research has been conducted to support or…

Providers of tests of languages for academic purposes generally claim to provide evidence on the extent to which students are likely to be able to cope with the future demands of reading in specified real-life contexts. Such claims need to be supported by evidence that the texts employed in the test reflect salient features of the texts the test…

Testing and assessment in English-for-Academic-purposes (EAP) contexts has traditionally been carried out as a needs analysis of learners or a content analysis of courses. This article reassesses this approach to the development and validation of EAP tests on the basis of a theoretical model and recent research into content specificity. (VWL)