The purpose of this article of reflection is to raise awareness of how poor design of language assessments may have detrimental effects, if crucial qualities and technicalities of test design are not met. The article first discusses these central qualities for useful language assessments. Then, guidelines for creating listening assessments, as an…

Inattentiveness and social desirability might be particularly problematic for self-report scales in creativity and arts research. Respondents who are inattentive or who present themselves favorably will score highly on scales that yield positively skewed distributions and that assess socially valued constructs, such as scales measuring creativity…

The effect of high-stakes language tests on teaching and learning a language is usually known as washback. The true nature of test washback can be understood only by taking account of the educational, cultural, political and social contexts in which the test operates. Nevertheless, little research has explored the factors that affect the nature of…

Developing and writing assessment items that measure teachers' knowledge is an intricate and complex undertaking. In this paper, we begin with an overview of what is known about measuring teacher knowledge. We then highlight the challenges inherent in creating assessment items that focus specifically on measuring teachers' specialised knowledge…

Given that teaching Arabic, as a second language has become increasingly significant in the present context, it follows that there is an urgent and pressing need to develop efficient learning tools as well as adequate measuring tools for testing the learner's development. There are numerous problems associated with measuring a learner's…

In the test-centric Thai education system, results on national exams are often viewed as indicators of educational success. These exams use multiple-choice which can have detrimental effects on students' attitudes and learning. If school assessments also rely on multiple-choice exams, the situation would be worrying, yet there is little data…

A method for medical screening is adapted to differential item functioning (DIF). Its essential elements are explicit declarations of the level of DIF that is acceptable and of the loss function that quantifies the consequences of the two kinds of inappropriate classification of an item. Instead of a single level and a single function, sets of…

In July 2010, the Massachusetts Board of Elementary and Secondary Education (BESE) voted to adopt Common Core's standards in English language arts (ELA) and mathematics in place of the state's own standards in these two subjects. The vote was based largely on recommendations by Commissioner of Education Mitchell Chester and then Secretary of…

As homework and other aspects of education migrate to a computer-based format, on-paper exams are beginning to seem like an anachronism. Online delivery is attractive, but comes with a myriad of implications not apparent at first glance. It affects the kinds of questions that can be asked and complicates administration of the exam, but it may make…

Spain is currently living a transitional situation. In 2013 a new educational law was passed, the Organic Law that Modifies the Quality of Education (LOMCE). That law, among many other aspects, introduces the use of standardized external tests either to (1) guide or provide suggestions for the educational track, or (2) to obtain inferences towards…

T&I programmes aim to produce self-reliant graduates capable of judging their own work against agreed criteria and increasing their levels of competence over the course of their careers. An essential element to achieve this goal is student-centred assessment, i.e. 'assessment as learning' (AaL) (also known as 'sustainable assessment'), which…

High stake tests are known to drive curricula and affect teachers and learners in numerous ways; what has come to be known as test washback. Thus far, almost all washback studies have focused on national or international language proficiency tests. There are little, if any, researches addressing the washback of high stake tests of English…

In educational assessments two types of missing responses can be discerned: items can be "not reached" or "skipped". Both types of omissions may be related to the test taker's proficiency, resulting in non-ignorable missingness. This paper proposes to model not reached and skipped items as part of the response process, using…

The study aims to investigate washback of the English National Exam (ENE) on learning and how they impacted English language learning strategies of first-year English majors at University of Foreign Language Studies, The University of Danang (UFLS, UD). Data was collected from a questionnaire administered to 120 first-year English majors and an…

Test takers' beliefs or experiences have been overlooked in most validation studies in language education. Meanwhile, a mutual exclusion has been observed in the literature, with little or no dialogue between validation studies and studies concerning the uses and consequences of testing. To help fill these research gaps, a group of Senior III…