Over the past decades, the application of Rasch measurement in language assessment has gradually increased. In the present study, we coded 215 papers using Rasch measurement published in 21 applied linguistics journals for multiple features. We found that seven Rasch models and 23 software packages were adopted in these papers, with many-facet…

The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously,…

The online placement test for the Community English Language Program (CLP) at Teachers College, Columbia University has been administered in a computer lab since 2015. While most of the components of this placement exam system are online, including registration, exam delivery, scoring, and score reporting, the COVID-19 pandemic elevated the need…

Diagnostic classification models (aka cognitive or skills diagnosis models) have shown great promise for evaluating mastery on a multidimensional profile of skills as assessed through examinee responses, but continued development and application of these models has been hindered by a lack of readily available software. In this article we…

It is argued in this article that user actions need to be monitored to understand what has happened during the learning process. Monitoring on its own is not enough; user actions also need to be controlled to some degree so that users can receive the guidance they need to help them to the successful completion of the learning tasks in CALL…

Reports on the potential problems in scoring responses to sequencing tests, the development of a computer program to overcome these difficulties, and an exploration of the value of scoring procedures. (Author/VWL)

Describes a three-phase process model for interface design, drawing on practices developed in the software industry and adapting them for computer-based languages tests. Describes good practice in initial design, emphasizes the importance of usability testing, and argues that only through following a principled approach to interface design can the…

Statistical analysis tools in language testing are described, chiefly classical test theory and item response theory. Computer software for statistical analysis is briefly reviewed and divided into three tiers: commonly available; statistical packages; and specialty software. (Author/VWL)

FACETS many-facet Rasch analysis software was utilized to look at two consecutive administrations of a large-scale second language oral assessment in the form of a peer group discussion task with Japanese English-major university students. Results are discussed. (Author/VWL)

This study compared the exam performance of 65 foreign students of Dutch whose homework had been regularly checked by a computer program with 62 students whose homework had been randomly checked. On a 100-item proficiency test the former group obtained an average score of 77.2, while the latter group obtained an average score of 65.4. (Contains 21…

This article reports on the Pittsburgh Public Schools Oral Ratings Assessment for Language Students (PPS ORALS) project, a Title VI Foreign Language Assistance Program grant-funded project to create an online testing Software program that makes large-scale oral testing in a world language not only feasible, but also easy to create, administer, and…

The collection of 12 essays brings together work by linguists around the world concerning the use of computers in applied linguistics, including computer-assisted language learning (CALL). Articles include: "Humanism and CALL: A Coming of Age" (Vance Stevens); "A Methodological Framework for CALL Courseware Development" (Philip Hubbard);…

This collection of essays on measurement theory and language testing includes: "Computerized Adaptive Testing: Implications for Language Test Developers" (Peter Tung); "The Promise and Threat of Computerized Adaptive Assessment of Reading Comprehension" (Michael Canale); "Computerized Rasch Analysis of Item Bias in ESL…