In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

Developing a diagnostic tool within the diagnostic measurement framework is the optimal approach to obtain multidimensional and classification-based feedback on examinees. However, end users may seek to obtain diagnostic feedback from existing item responses to assessments that have been designed under either the classical test theory or item…

This study presents the development and empirical validation of score levels and descriptors specifically designed for reporting purposes to provide test takers with more than just a number on a score scale. In the context of a test primarily intended for 11- to 15-year-old students learning English as a second/foreign language, the study examined…

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is…

The study anchors on the Linguistic research tradition of Error Analysis (EA), focused on the grammatical errors, specifically on "verb tenses" manifested in the sentences of Japanese ESL learners. The entire respondent population was drawn from the pool of registered learners in 2017 at the Clark Institute of the Philippines Foundation,…

The purpose of this study was to enhance the meaning of the scores of an English-language test by developing performance levels and descriptors for reporting overall test performance. The levels and descriptors were intended to accompany the total scale scores of TOEFL Junior® Standard, an international test of English as a second/foreign…

The current study examined the effects of text-based relational (i.e., cohesion), propositional-specific (i.e., lexical), and syntactic features in a source text on subsequent integration of the source text in spoken responses. It further investigated the effects of word integration on human ratings of speaking performance while taking into…

This study aims to examine the relationship between reading comprehension and lexical and grammatical knowledge among English as a foreign language students by using an Artificial Neural Network (ANN). There were 825 test takers administered both a second-language reading test and a set of psychometrically validated grammar and vocabulary tests.…

Over the years, the multiple intelligences theory (MIT) proposed by Howard Gardner has renewed interest in learners' use of effective learning strategies and produced interesting results. This MIT-oriented study investigated the role of successful L2 readers' multiple intelligences in their effective use of reading strategies. To this end, a TOEFL…

Based on Robinson's (2005) Cognition Hypothesis and Skehan and Foster's (2001) Limited Attentional Capacity Model, the current study attempted to investigate the effect of manipulating task complexity on argumentative writing quality in terms of lexical complexity, fluency, grammatical accuracy, and syntactic complexity. Task complexity was…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

The primary focus of research on employment of language learning strategies has been on identification of adoption of different learning strategies. However, the relationship between language learning strategies and proficiency levels was ignored in previous research. The present study was undertaken to find out whether there are any relationship…

This paper presents the author's response to Xiaoming Xi's article titled "How do we go about investigating test fairness?" In this response, the author focuses on test fairness and Toulmin's model of argument structure, Xi's proposal, and the challenges the proposal brings. Xi proposes an approach to investigating test fairness to guide…

This study explores how second language (L2) texts written by learners at various proficiency levels can be classified using computational indices that characterize lexical competence. For this study, 100 writing samples taken from 100 L2 learners were analyzed using lexical indices reported by the computational tool Coh-Metrix. The L2 writing…

This paper reports findings from the study that assessed the first year Indian ESL students' awareness of reading strategy use. It also investigated the relationship that exists between reading strategy use and the reading comprehension achievements of the Indian ESL students. The study utilized two instruments such as SORS and RCT which is the…