Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective…

Language proficiency diagnosis is essential to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Different from comprehensive standardized tests, many language learning apps often revolve around word-level questions. Therefore, knowledge…

Thinking skills play a critical role in determining language performance. Recent advancement in cognitive diagnostic modelling (CDM) provides a powerful tool for obtaining fine-grained information regarding these thinking skills during reading. Studies are scant, however, exploring the relations between thinking skills and language performance,…

Drawing on Glenn Fulcher's extensive work in performance-based language assessment of speaking, this paper explores the assessment of L2 speaking ability in local language testing contexts. For that purpose, I review Fulcher's influential work that highlights the relationship between the speaking construct, the task, the performance, and the…

Purpose: Multilingual children are disproportionately represented on speech pathology caseloads, in part due to the limited ability of traditional language assessments to accurately capture multilingual children's language abilities. This systematic review evaluates the evidence for identification of language disorder in multilingual children…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

This study uses a complexity-accuracy-lexis-fluency (CALF) framework to explore performance on 2 speaking tasks: a narrative picture-based task and an interactive decision-making task. A preliminary aim is to compare performance on the 2 tasks, using a wide range of CALF measures to explore where scores are similar and where they are different.…

The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation…

This study investigated the effects of two types of classroom instructions on EFL learners' oral proficiency by implementing teachers' judgment. Two intact classes of EFL university students studied a compulsory subject of their department under two different types of classroom instruction. The first group of students was trained with explicit…

In L2 assessment research, assessments have traditionally been associated with large-scale testing or formal proficiency tests, primarily to record student achievement (Turner & Purpura, 2016). Classroom-based assessments (CBAs), then, are seen as offshoots of large-scale tests, thus, designed similarly (Turner, 2012). However, CBAs serve a…

This paper presents a methodology for directly aligning 'can do' frameworks to each other. The methodology, inspired by the manual for relating examinations to the "Common European Framework of Reference for Languages: Learning, teaching, assessment" (CEFR) (Council of Europe, 2009) and Kane's (2004, 2013) interpretative argument, takes…

This study aimed to profile the sublexical, lexical, and text level language skills, and cognitive processes of a sub-group of children with poor reading comprehension known as poor comprehenders. An assessment protocol was developed to assess each of the components from Perfetti and Stafura's Reading Systems Framework. A comprehensive profile was…

This paper explores, through the use of the observation checklist and Conversation Analysis (CA), the discourse functions elicited by the dialogic task of the Free University of Bolzano (IT) speaking test. It aims to contribute to content validation, which has been claimed to be especially relevant in paired speaking tests, where interaction is…

Institution-Wide Language Programme (IWLP) modules are a popular option for international students at the University of Reading. Student feedback and module results show that some of these students face particular challenges in relation to their peers. In this paper, we describe how a team teaching Beginners French -- Common European Framework of…

The OECD Programme for International Student Assessment (PISA) assesses the extent to which 15-year-old students near the end of their compulsory education have acquired the knowledge and skills essential for full participation in modern societies. The assessment does not just ascertain whether students can reproduce knowledge; it also examines…