This paper, the fourth in a series concerned with the level of access afforded to students who use educational interpreters, focuses on the intelligibility of interpreters who use Signing Exact English (SEE). Eight expert receivers of SEE were employed to evaluate the intelligibility of transliterated messages that varied in accuracy and lag time.…

Purpose: This paper is a critical reflection on the linguistic conservatism as found within current curriculum policies and assessment regimes in the UK, arguing that they represents a form of linguicism which serves to entrench linguistic social injustices. This paper aims to trace the "trajectory" of policy across different levels,…

The authors describe Monster, PI, which is an app-based, gamified assessment that measures language skills (knowledge of morphology, vocabulary, and syntax) of students in grades 5-8 and provides teachers with interpretable score reports to drive instruction that improves vocabulary, reading, and writing ability. Specifically, the authors describe…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020…

Purpose: In this letter, the authors respond to Pavelko and Owens' (2017) newly advanced set of procedures for language sample analysis: Sampling Utterances and Grammatical Analysis Revised (SUGAR). Method: The authors contrast some of the new guidelines for transcription, morpheme segmentation, and language sample elicitation in SUGAR with…

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

Educational assessment data are often collected from a set of test centers across various geographic regions, and therefore the data samples contain clusters. Such cluster-based data may result in clustering effects in variance estimation. However, in many grouped jackknife variance estimation applications, jackknife groups are often formed by a…

This study is a literature review on the findings of different studies on the dimensionality of language proficiency. It aims to particularly analyze the assumptions and the statistical findings of relevant research since it has always been an endless debate among linguists and language teachers about whether language proficiency is organized as a…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

The aims of this study were 1) to examine the effectiveness of the World Englishes instructional model in enabling students to improve their listening comprehension towards varieties of English, and 2) to investigate students' attitudes towards the use of the World Englishes instructional model. The methodology of this study followed a…

Purpose: This research compared individuals from two first language (L1) backgrounds (English and Japanese) to determine how they may differ in their perception of Mandarin tones (Tones 1 vs. 2 [T1-T2], Tones 1 vs. 3 [T1-T3], Tones 1 vs. 4 [T1-T4], Tones 2 vs. 3 [T2-T3], Tones 2 vs. 4 [T2-T4], Tones 3 vs. 4 [T3-T4]) on account of their L1. Method:…

Combining Bachman's (1990) conceptualization of content validity with Messick's (1989) unifying model of construct validity, this study attempted to fill the gap in researching content validation in the context of a university reading achievement test by (a) examining traditional content validity evidence and (b) analyzing the test scores to…

The study investigates which grammar features need high priority of pedagogical intervention to develop implicit knowledge, unlike grammatical features in need of explanation of explicit rules. Two types of data were collected from 29 Korean college students: a sentence completion test in English and a meta-linguistic knowledge test (requiring…

Apart from speaking competence and vocabulary used, refusal strategies play an important role in a communication scenario. This paper investigates how Thai students realise the speech act of refusals to the initiating acts of suggestions, offers, requests, and invitations with regard to the status of the interlocutor. To achieve this objective,…