Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

This article presents the process of constructing and validating a test of metalinguistic awareness (MLA) for young school children (age 8-10). The test was developed between 2021 and 2023 as part of the MetaLearn research project, financed by The Research Council of Norway. The research team defines MLA as using metalinguistic knowledge at a…

Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

Purpose: Pragmatics is receiving much attention in both the fields of developmental and clinical psychology; however, there is a dearth of instruments to assess pragmatic abilities specifically among young toddler-age children. The aim of the current study was to test the psychometric properties of the Italian version of the Language Use Inventory…

The study evaluated the convergent validity of the PEAK-E-PA and two common assessments of language development used in educational and clinical settings: the ABLLS-R and the TOLD-I:4. The PEAK-E-PA provides a measure of a participant's ability to derive arbitrary stimulus relations, and may therefore provide a more complex analysis of language…

Existing methods used to validate self-report questionnaires in foreign language teaching effectiveness have relied on Classical Test Theory (CTT). However, the use of CTT approaches limits the reliability and validity of self-report instruments. The Rasch Model, which is based on the principles of objective measurement, addresses some of the…

This study aimed to adapt the Plurilingual and Pluricultural Competence scale (PPC) to the Russian-speaking population and to assess its psychometric properties. Five hundred and sixty-four undergraduate students from Western, Central, and Caucasian regions of Russia and Kazakhstan participated in the study. Internal consistency, factorial,…

This study provides a preliminary validation of a Greek Sentence Repetition Task (SRT) with a sample of 110 monolingual and bilingual typically developing (TLD) children and examines the test's ability to distinguish between Greek monolingual children and age-matched Albanian-Greek bilinguals using a Receiver Operating Characteristics (ROC)…

This study investigates children's vocabulary knowledge in Finnish Sign Language (FinSL), specifically their understanding of different form-meaning mappings by using a multilayered assessment format originally developed for British Sign Language (BSL). The web-based BSL vocabulary test by Mann (2009) was adapted for FinSL following the steps…

The purpose of this paper is to (a) establish whether meaning recall and meaning recognition item formats test psychometrically distinct constructs of vocabulary knowledge which measure separate skills, and, if so, (b) determine whether each construct possesses unique properties predictive of L2 reading proficiency. Factor analyses and…

Background: Creating a holistic picture of children and youth who suffer from acquired aphasia or another (developmental) language disorders is very difficult due to missing diagnostic instruments covering participation. Szenario-Kids is a new diagnostic instrument to measure multimodal communication abilities in everyday life situations of…

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

This study evaluated the validity of the Michigan English Test (MET) Listening Section by investigating its underlying factor structure and the replicability of its factor structure across multiple test forms. Data from 3255 test takers across four forms of the MET Listening Section were used. To investigate the factor structure, each form was…

The current study describes the development and validation of a novel scale (BILEX) designed to assess young bilingual children's receptive vocabulary in both languages, their conceptual vocabulary, and translational equivalents. BILEX was developed to facilitate the assessment of vocabulary size for both of the children's languages within one…