The lack of comprehensive language proficiency assessment models recognizing the nonlinearity and dynamicity of individual differences, as well as the fundamental differences between paper- and computer-assisted language assessments (CALA) served as the rationale to conduct the present study. Drawing on dynamic systems theory, a Nonlinear Dynamic…

This study investigates the differential impacts of various online language assessment models--specifically, the Nonlinear Dynamic Individual-Centered Language Assessment (NDICLA), diagnostic assessment, and formative assessment--on the cognitive load and learning outcomes of English as a Foreign Language (EFL) learners within computer-assisted…

Background: Validity is a notable concept in language testing which has concerned many researchers and scholars in the field of language testing due to its importance in decision making process. Tests' results always introduce consequences to test takers' lives which emphasizes the need to ensure their validity. Detecting and delineating the…

In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components.…

The heightened importance of foreign languages (L2) in the post 9-11 world demands more L2 listening research as listening is considered the most critical skill for most American military linguists. Some larger studies show that lexical knowledge can positively affect L2 listening (Chang, 2007; Mehrpour & Rahimi, 2010; Staehr, 2009), yet…

One of the major aims of discourse-processing literature is to understand whether and when readers form discourse-level representations online. To test this, two word-by-word, self-paced reading experiments investigated the time course of integrating incoming information about the protagonist into the unfolding discourse-level representation in…

Research on linguistic variation suggests that usage patterns are deeply embedded in native and non-native speakers' knowledge of grammar. This study explores the transfer of these variable sociolinguistic patterns at the initial stages of third language acquisition. We elicited narratives in Portuguese from two mirror-image groups of sequential…

Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for…

The present study examines the relative importance of attributes within and across items by applying four cognitive diagnostic assessment models. The current study utilizes the function of the models that can indicate inter-attribute relationships that reflect the response behaviors of examinees to analyze scored test-taker responses to four forms…

The purpose of the present study is to assess second language (L2) spoken English using automated scoring techniques. Automated scoring aims to classify a large set of learners' oral performance data into a small number of discrete oral proficiency levels. In automated scoring, objectively measurable features such as the frequencies of lexical and…

This paper examines how different test methods may tap different aspects of second language knowledge. It employs multiple-choice (MC) and constructed response (CR) items which yield distinct or convergent information in the computer delivered testing of English in its presentation of this factor. In order to examine the effects of test method, a…

This report describes the initial automated scoring results that were obtained using the constructed responses from the Writing and Speaking sections of the pilot forms of the "TOEFL Junior"® Comprehensive test administered in late 2011. For all of the items except one (the edit item in the Writing section), existing automated scoring…

Competition Model studies of second language learners have demonstrated that there is a gradual replacement of first language cues for thematic role assignment by second language cues. The current study introduced two methodological innovations in the investigation of this process. The first was the use of mouse-tracking methodology (Spivey, 2007)…

The growing number of students from increasingly diverse backgrounds--both English speaking and non-English speaking--entering English-medium institutions of higher education has put unprecedented pressure on universities to think creatively about efficient and cost-effective ways of identifying students at risk linguistically. Having done so,…

For native (L1) comprehenders, lower-level language processes such as lexical access and parsing are considered to consume few cognitive resources. In contrast, these processes pose considerable demands for second-language (L2) comprehenders. Two reading-time experiments employing inconsistency detection found that English learners did not detect…