The outbreak of the COVID-19 pandemic has transformed the educational landscape in a way unseen before. Educational institutions are navigating between offline and online learning worldwide. Computer-based testing is rapidly taking over paper-and-pencil testing as the dominant mode of assessment. In some settings, computer-based and…

This study is a conceptual replication of Ellis' 'Measuring implicit and explicit knowledge of a second language: A psychometric study', published in "Studies in Second Language Acquisition" (2005), aiming to establish the importance of including belief statements (hypothesized to increase processing demands) in the design of Elicited…

This article describes the development of a new questionnaire for assessing L2 learners' language attitudes. Drawing on theoretical work in the fields of social psychology and applied linguistics, the author reviewed the concept of (language) attitudes and contrasted them with the concept of (language) motivation. This thorough literature review,…

Conceptual Metaphor (CM; e.g., Lakoff & Johnson, 1980, 1999; Kovecses, 2020) is central to our thinking and ubiquitously manifested in our language. Given its importance, the teaching of conceptual metaphors has gained much attention in Cognitive Linguistics and Applied Linguistics. While most empirical studies have focused on specific aspects…

Testing organizations are faced with increasing demand to provide subscores in addition to the total test score. However, psychometricians argue that most subscores do not have added value to be worth reporting. To have added value, subscores need to meet a number of criteria: they should be reliable, distinctive, and distinct from each other and…

Although much research has compared the functioning between analytic and holistic rating scales, little research has compared the functioning of binary rating scales with other types of rating scales. This quantitative study set out to preliminarily and comparatively validate binary and analytic rating scales intended for use in formative…

Consideration of the influence of English language skills during testing is an understandable requirement for fair and valid cognitive test interpretation. Several professional standards and expert recommendations exist to guide psychologists as they attempt to engage in best practices when assessing English learners (ELs). Nonetheless, relatively…

Recent empirical research has demonstrated the importance of mastery motivation in child development. Therefore, it is essential to have valid and reliable instruments to measure this variable. The Dimensions of Mastery Questionnaires (DMQ 18) was validated in English, Hungarian, Chinese and Spanish. In this article, we evaluate the psychometric…

The aim of this study is to adapt the Crick Learning for Resilient Agency (CLARA) to Turkish culture, and to examine the psychometric features of the Inventory according to both Classical Test Theory (CTT) and Item Response Theory (IRT). In this respect, it is a descriptive level survey design research. Two different study groups were formed in…

This study aimed at comparing two types of IELTS writing task 1 namely, bar charts and tables of Iranian test takers in terms of four IELTS writing assessment criteria including task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study also sought to identify test takers' strengths and weaknesses in the…

This study investigated the cognitive validity of two child English language tests. Some teachers maintain that these types of tests may be cognitively invalid because native-English-speaking children would not do well on them (Winke, 2011). So the researchers had native speakers and learners of English aged 7 to 9 take sample versions of two…

The purpose of the present study is to compare the psychometric qualities of canonical single-response multiple-choice items with their double-response counterparts. Thirty, two-response fouroption grammar items for undergraduate students of English were constructed. A second version of the test was constructed by replacing one of the correct…

The importance of listening in the context of English language acquisition is gaining acceptance, but its unique attributes in language performance, while substantively and qualitatively justifiable, are generally not psychometrically defined. This article psychometrically supports listening as a distinct domain among the three other domains of…

The "e-rater"® automated essay scoring system is used operationally in the scoring of "TOEFL iBT"® independent and integrated tasks. In this study we explored the psychometric added value of reporting four trait scores for each of these two tasks, beyond the total e-rater score.The four trait scores are word choice, grammatical…

Second language vocabulary acquisition has been modeled both as multidimensional in nature and as a continuum wherein the learner's knowledge of a word develops along a cline from recognition through production. In order to empirically examine and compare these models, the authors assess the degree to which the Vocabulary Knowledge Scale (VKS;…