In this paper we use historic score-reporting records and test-taker metadata to inform data-driven recommendations that support international students in their choice of undergraduate institutions for study in the United States. We investigate the use of Structural Topic Modeling (STM) as a context-aware, probabilistic recommendation method that…

Although several studies have explored the effects of task sequencing on second language (L2) production, there is no established set of criteria to sequence tasks for learners in L2 writing classrooms. This study examined the effect of simple ?complex task sequencing manipulated along both resource-directing (± number of elements) and…

As English continues to spread as an international lingua franca, there is a growing diversity in its use around the world. As a result, there are calls for embracing the diversity in the teaching, learning and assessment of the language. At the same time, there is a growing criticism against the widely taken language tests such as the Test of…

In this study, we assessed the invariance in the factor structure underlying English-language proficiency for two groups of adolescent learners in Japan: students in middle school (ages 13-15 years) and students in high school (ages 16-18 years). Language proficiency was measured using the "TOEFL Junior"® Comprehensive test, an…

This study explored the relationships among language proficiency, two selected test-taker characteristics (i.e., topical knowledge and anxiety), and integrated speaking test performance. Data collection capitalized on three sets of instruments: three integrated tasks derived from TOEFL-iBT preparation materials, the state anxiety inventory created…

In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components.…

This study investigates two models of L2 vocabulary acquisition at an advanced L2 level: L1 lemma mediation and the revised hierarchical models. Proponents of the L1 lemma mediation model postulate that advanced L2 learners map L2 words to L1 meanings or concepts, whereas proponents of the revised hierarchical model argue that the increasing…

Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for…

The present study explores the relationship between controlled productive knowledge of collocations and L2 proficiency, the role of frequency in controlled productive knowledge of collocations, and the quantifiability of controlled productive collocational knowledge growth alongside L2 proficiency and word frequency levels. A proficiency measure…

Previous research in cognitive diagnostic assessment (CDA) of L2 reading ability has been frequently conducted using large-scale English proficiency exams (e.g., TOEFL, MELAB). Using CDA, it is possible to analyze individual learners' strengths and weaknesses in multiple attributes (i.e., knowledge, skill, strategy) measured at the item level.…

This report describes the initial automated scoring results that were obtained using the constructed responses from the Writing and Speaking sections of the pilot forms of the "TOEFL Junior"® Comprehensive test administered in late 2011. For all of the items except one (the edit item in the Writing section), existing automated scoring…

This study designed a model of teaching reading for university EFL students based on the English curriculum at the Faculty of Languages and Literature and the concept of the team-based learning in order to improve the reading comprehension of the students. What kind of teaching model can help students to improve their reading comprehension? The…

Investigated the nature of second-language proficiency with respect to its divisibility and components. The correlated-traits and second-order hypotheses were evaluated using 354 students learning English-as-a-Second-Language, a wide range of language proficiency measures, and comfirmatory data-analytic techniques. (36 references) (Author/OD)

Although programs for teaching and testing of English as a second language (ESL) are often evaluated for their attention to communicative competence, there is no consensus on the nature of the communicative competence construct(s) and little empirical support for the various explanatory models. The theoretical literature related to communicative…