Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

Language proficiency diagnosis is essential to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Different from comprehensive standardized tests, many language learning apps often revolve around word-level questions. Therefore, knowledge…

Since the inception of the Language Instruction for Newcomers to Canada (LINC) Program in 1992, the Canadian federal government, through the ministry responsible for immigration, has diligently sought to bring consistency to the program through a variety of government initiatives. These include operational bulletins, curriculum guidelines,…

One of the most critical steps in the test development process is defining the construct, or the knowledge, skills, or abilities, to be assessed. This foundational step provides the basis for initial assumptions about the meaning of test scores and serves as a reference for subsequent validity research. In this paper, we describe the purpose of…

The authors illustrate models and procedures that can be applied to calculate overall composite scores in order to identify an indicator of English language proficiency, based on composite scores for English learners with 504 or individualized education plans who are missing one or more domain scores on the Assessing Comprehension and…

This article analyzes the instructed learning of the English article system by second language (L2) learners. The Competition Model (MacWhinney, 1987, 2012) was adopted as the theoretical framework for analyzing the cues to article usage and for designing effective computer-based article instruction. Study 1 found that article cues followed a…

This study discusses the self-assessments of over 22,500 students on a set of 12 can-do statements that are taken from the Common European Framework of Reference (CEFR). The students' endorsement or negation of the statements reflects their sense of self-efficacy in English reading, writing, and listening. Their self-efficacy beliefs are compared…

This article explores ways in which learners' achievements can be assessed and reflected in both the domains of linguistic performance and subject-content learning. The content and language integrated learning (CLIL) approach adopted by the authors is one in which language learning and content learning are truly integrated and where neither…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

This paper provides a summary of a novel and integrated way to think about the item response models (most often used in measurement applications in social science areas such as psychology, education, and especially testing of various kinds) from the viewpoint of the statistical theory of generalized linear and nonlinear mixed models. In addition,…

A variety of cognitive diagnosis approaches (CDAs) have been used by researchers to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Although some of these approaches have been in use in the psychometric community for quite some time, many…

This study employed Bachman and Palmer's (2010) Assessment Use Argument framework to investigate to what extent the use of a second language oral test as an exit test in a Hong Kong university can be justified. It also aimed to help test developers of this oral test identify the most critical areas in the current test design that might need…

Traditionally, practitioners interested in language test reform have focused on the qualities within an examination which result in either positive or negative impacts on participants, institutions, and society. Recent views suggest a multifaceted interaction among factors affecting language test reform. We introduce a model for test reform that…

This article contends that the necessary links between constructs and test scores/decisions in language assessment must be established through principled design procedures that align three models: (1) a theoretical construct model; (2) a test development model; and (3) a psychometric scoring model. The theoretical construct model articulates the…

An attempt is made is this paper to examine the validity of the American Council on the Teaching of Foreign Languages (ACTFL) scale through a comparison of the scaling of speaking tasks and speech performances by the scale and by a Rasch analysis of judgments made by "naive" persons. The results of the multi-faceted Rasch analysis seem…