We introduce a short answer scoring engine made up of an ensemble of deep neural networks and a Latent Semantic Analysis-based model to score short constructed responses for a large suite of questions from a national assessment program. We evaluate the performance of the engine and show that the engine achieves above-human-level performance on a…

The Hanyu Shuiping Kaoshi (HSK) is a multi-level, multi-purpose Chinese proficiency test developed by the Center for Language Education and Cooperation (previously the Office of Chinese Language Council International and, henceforth, referred to by its colloquial name "Hanban"). It assesses reading, writing, and listening skills of…

This test review focuses on the current version (2009) of [Chinese characters omitted] (Hanyu Shuiping Kaoshi), literally translated as the Chinese Language Proficiency Test and abbreviated as HSK. Tailored to non-native speakers of the Chinese language, this test consists of six proficiency levels (Levels 1 and 2 as beginners, Levels 3 and 4 as…

In his philosophical novel, Thus spoke Zarathustra, Nietzsche (1883-85), famously wrote, 'God is dead,' signifying that God is no longer credible as an absolute moral compass. Over a century later, Paikeday (1985), proclaimed that "The native speaker is dead!" in his book title, implying that the native speaker as the arbiter of what is…

This article presents a critical review of the Texas English Language Proficiency Assessment System (TELPAS), a large scale standardized English language proficiency (ELP) assessment developed by the Texas Education Agency (TEA) and administered since 2004. TELPAS is used as an annual summative assessment for all English Learners (ELs) in grades…

This article employs the Common European Framework Reference for Language Acquisition (CEFR) as a basis for evaluating writing in the context of machine scoring. The CEFR was designed as a framework for evaluating proficiency levels of speaking for the 49 languages comprising the European Union. The intent was to impact language instruction so…

This article investigates ways to improve the assessment of English learner students' English language proficiency given the current movement of creating next-generation English language proficiency assessments in the Common Core era. In particular, this article discusses the integration of scaffolding strategies, which are prevalently utilized as…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

Testing of second language pragmatic competence is an underexplored but growing area of second language assessment. Tests have focused on assessing learners' sociopragmatic and pragmalinguistic abilities but the speech act framework informing most current productive testing instruments in interlanguage pragmatics has been criticized for…

The two authors conducted a small empirical study to attempt to find support for--or evidence against--the view that international tests of English language proficiency are unfair to speakers of non-standards forms of English, since these tests privilege standard forms. We explore the question of whose norms should be imposed in these tests, and…

This article describes the language skills and factors that predict English-language proficiency for a sample of 209 students ages 10 to 16 from three immigrant groups--Chinese, Dominican, and Haitian. Sources of data included structured student interviews, parent interviews, and individual language assessments. On average, students'…

Practitioners working closely with second language (L2) writers in the US recognize at least two types of L2 students: international (IL2) and Generation 1.5 (G1.5) students. Some argue that specific differences in each group's writing performance are evident (cf. Harklau, 2003; Reid, 2006); however, investigations into observable and measurable…

Our recent review of content assessments revealed that language expectations and proficiencies are often implicitly embedded within the assessment criteria. Based on a review of performance assessments used in high school biology settings, we have found a recurring discrepancy between assessment scoring criteria and performance expectations. …

The Language Proficiency Interview's structure, administration, and rating scale are outlined by an officer of the organization that designed it (Educational Testing Service), and some common mistakes made in its administration are listed. The need for training in the test's administration is emphasized. Its application in the corporate situation…

Several English and Spanish language tests currently used in bilingual education and some less known tests are reviewed, looking at both historic and psychometric factors. It is suggested that practitioners have commonly assumed that all language tests are basically valid, which contributed to the commercial success of some tests of questionable…