In investigations of unusual testing behavior, a common question is whether a specific pattern of responses occurs unusually often within a group of examinees. In many current tests, modern communication techniques can permit quite large numbers of examinees to share keys, or common response patterns, to the entire test. To address this issue,…

This study investigates washback effects of IELTS test on university teachers' adoption of teaching materials in the classroom in China and see how a high-stake language exam affects their teaching practices and how they and their students perceive the effectiveness of the pedagogic adjustments. To this end, individual interview to five teacher…

Understanding the IELTS washback on learning in English as a Foreign Language (EFL) in higher education contexts remains limited. To fill in this research gap, this study investigated washback effects of the International English Language Testing System (hereafter called IELTS) as an English language proficiency exit test for final-year English…

In "Adapting Educational Measurement to the Demands of Test-Based Accountability" Koretz takes the time-honored engineering approach to educational measurement, identifying specific problems with current practice and proposing minimal modifications of the system to alleviate those problems. In response to that article, David Thissen…

M-learning has enhanced the e-learning by making the learning process learner-centered. However, enforcing exam security in open environments where each student has his/her own mobile/tablet device connected to a Wi-Fi network through which it is further connected to the Internet can be one of the most challenging tasks. In such environments,…

The teaching and learning process changed into an online during the COVID19 outbreak, and thus online evaluation became a requirement. This research examines the positive and negative effects of online assessment on students' learning behaviour and how teachers prepare their teaching. This case study research included the result of questionnaire…

Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective…

Reclassification is a critical threshold when English Learners (ELs) exit specialized language services and access all-English mainstream classrooms. Despite the mandates of the Every Student Succeeds Act, reclassification rates and time remain a pressing problem. A product of this malfunctioning system has been long-term ELs (LTELs). This article…

Test security is not an end in itself; it is important because we want to be able to make valid interpretations from test scores. In this article, I propose a framework for comprehensive test security systems: prevention, detection, investigation, and resolution. The article discusses threats to test security, roles and responsibilities, rigorous…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Documents are usually circulated as carriers of transparent information. They can serve as evidence of accountability. In fact, they embody the most desired value of managerialism, where the culture of audit and compliance is fully served and delivered in written and textual form. This article explores assessment by attending to its principal…

Current methods that simultaneously model differential testlet functioning (DTLF) and differential item functioning (DIF) constrain the variances of latent ability and testlet effects to be equal between the focal and the reference groups. Such a constraint can be stringent and unrealistic with real data. In this study, we propose a multigroup…

The OECD Programme for International Student Assessment (PISA) provides a framework in which over 80 countries collaborate to build advanced global metrics to assess the knowledge, skills and character attributes of the students. The design of assessments poses major conceptual and technical challenges, as successful learning. Beyond a sound…

The high-stakes College English Test (CET), developed, administered, and reformed over the last 20 years, has received great attention in the aspect of washback on teaching and learning from previous research. Very few studies explored its consequences in the workplace domain--being used as a screening lever. This research aimed to 1) compare…

This study analyses teachers' viewpoints on the potential undesirable influences of high stake exams. Seven stimulants related to undesirable influences of high stake exams on education were given to 191 teachers in a pairwise comparisons format. The participating teachers in this study were asked to choose one undesirable influence by comparing…