Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

C-Test is a gap-filling test designed to measure first and second language proficiency. Over the past four decades, researchers have shown the fit of C-Test data to parametric item response theory (IRT) models, but no study so far has shown the fit of C-Tests to nonparametric IRT models. The purpose of this study is to contribute to the ongoing…

This study investigates the validity of syntactic priming as a measure of implicit language aptitude. Syntactic priming refers to the tendency to reproduce a linguistic structure due to a previous exposure to the structure. The validity of the construct was verified by collating evidence for divergent validity--whether it is dissociable from…

Recently a novel instrument -- the Core Academic Language Instrument (CALS-I) -- aimed at testing a constellation of school-relevant English language skills was developed and validated for use in the United States (Uccelli, Barr, Dobbs, Galloway, Meneses and Sánchez, 2015. Core Academic Language Skills: An expanded operational construct and a…

Background and Context: Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective: Developing and validating a new instrument for assessing young…

The Common European Framework of Reference for Languages Companion Volume (CEFR CV) emphasizes macro-functions of language (i.e., reception, production, interaction, and mediation). However, there seems to be little consensus on whether the macro-functions are commensurable with CEFR-based proficiency tests. This paper focuses on the Examination…

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of…

Various stakeholders, such as policymakers and educators, require diagnostic feedback and actionable test results. One particular context in which fine-grained test results are of utmost importance is English language proficiency (ELP) assessments as they are used for critical decisions for students. Diagnostic classification models (DCMs) afford…

This study reports on the development of a cooperative learning attitude scale for the EFL students based on expert reviews and examines its construct validity. Three rounds of expert reviews were conducted. In each round, five content experts reviewed the items and rated their relevance to the content domain and their comprehensibility. The…

Reverse engineering (RE) can play an important role in the re-designing tests in L2 English. It can also enrich the aim of teaching the same as raising children through academic achievement. In addition, it can play a key role in helping students understand how much their test is valid by using Standard reverse engineering (SRE). This paper is a…

In the US K-12 public school settings, each state's annual English language proficiency (ELP) assessment, as part of an educational accountability system, has tremendous impact on English learner (EL) students' academic paths and success. It is thus critical to establish a robust validation framework and empirical evidence to ensure that states'…

This study reports on the conceptualization of a new construct targeting the cross-disciplinary academic language skills most relevant to school reading comprehension, targeting the validation of the Core Academic Language Skills (CALS) Instrument, a novel assessment tool which measures this construct. Participants included Grade 4-8 monolingual…

This article provides preliminary validity evidence for the shorter Mandarin version of the Vocabulary Size Test (VST) under the content aspect, technical quality, substantive and generalizability aspect of Messick's (1995) construct validity framework. The shorter version with 177 Chinese university students in three proficiency levels indicates…

The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

This study is about the development and validation process of the Computerized Oral Proficiency Test of English as a Foreign Language (COPTEFL). The test aims at assessing the speaking proficiency levels of students in Anadolu University School of Foreign Languages (AUSFL). For this purpose, three monologic tasks were developed based on the Global…