Blended learning combines online and traditional classroom instruction, aiming to optimize educational outcomes. Despite its potential, student engagement with online components remains a significant challenge. Gamification has emerged as a popular solution to bolster engagement, though its effectiveness is contested, with research yielding mixed…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

How can one construct a test that provides accurate measurements across the range of performance levels while providing adequate coverage of all of the critical areas of the domain, yet that is not unmanageably long? This paper discusses the approach taken in a linear test of academic English language, and how the transition to a computer-based…

In today's environment of growing class sizes due to the prevalence of online and e-learning systems, providing one-to-one instruction and feedback has become a challenging task for teachers. Anyhow, the dialectical integration of instruction and assessment into a seamless and dynamic activity can provide a continuous flow of assessment…

The purpose of this study was to conduct a real-time multidimensional computerized adaptive test (MCAT) using data from a previous paper-pencil test (PPT) regarding the grammar and vocabulary dimensions of an end-of-term proficiency exam conducted on students in a preparatory class at a university. An item pool was established through four…

This report examines the Spanish language proficiency of fifth-grade students enrolled in the two-way Dual Language (DL) Program. Both native and non-native English speakers' Spanish language proficiency was assessed with the STAMP 4Se assessment in Spring 2020. Students were assessed on four domains of Spanish language proficiency (reading,…

This article reviews assessment practices of Japanese as a second language as taught in Japan since the 1980s. It begins with an explanation of the social and political conditions that have impacted assessment practices in Japan and then addresses current assessment practices and issues. This analysis first examines large-scale tests developed in…

This article describes the development and validation of the new CATSS (Computer Adaptive Test of Size and Strength), which measures vocabulary knowledge in four modalities -- productive recall, receptive recall, productive recognition, and receptive recognition. In the first part of the paper we present the assumptions that underlie the test --…

The first aim of this study was to develop a computer adaptive EFL test (CALT) that assesses test takers' listening and reading proficiency in English with dichotomous items and polytomous testlets. We reported in detail on the development of the CALT, including item banking, determination of suitable item response theory (IRT) models for item…

In the era of globalization, the trend towards learning Chinese as a foreign language (CFL) has become increasingly popular worldwide. The increasing demand in learning CFL has raised the profile of the Chinese proficiency test (CPT). This study will analyze in depth the inadequacy of current CPT's utilizing the common European framework of…

Considers computerized adaptive testing from the perspective of graphical modeling (GM). GM provides methods for making inferences about multifaceted skills and knowledge and for extracting data from complex performances. Provides examples from language-proficiency assessment. (SLD)

Discusses the development and use of a computer-adaptive test (CAT) for learners of Chinese. Each time the examinee answers a question, the CAT program registers the answer and, based on the examinee's response, decides whether the next question should be harder or easier. (23 references) (MDM)

This paper synthesizes ideas from the fields of graphical modeling and education testing, particularly item response theory (IRT) applied to computerized adaptive testing (CAT). Graphical modeling can offer IRT a language for describing multifaceted skills and knowledge, and disentangling evidence from complex performances. IRT-CAT can offer…

Discusses the possible limitations and the advantages of computer-assisted language testing and several test variables which are of concern in determining test validity. The concept of computer-adaptive testing and its relationship to these variables is described. (SED)

Developed a computerized adaptive language proficiency test for a community college in Quebec, Canada and obtained item response theory calibrations on the items from 700 to 800 administrations. Describes projected efforts to detect instances in which "cheating low" (answering incorrectly deliberately) occurs. (SLD)