As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

The purpose of this study was to develop and test the internal and external reliability of a novel research instrument which measures language support for international faculty members and its effects on integration. While previous research has focused on the contributions of international faculty and efforts to attract them, growing concerns…

This study presents a comparative analysis of classical reliability measures, including Cronbach's alpha, test-retest, and parallel forms reliability, alongside modern psychometric methods such as the Rasch model and Mokken scaling, to evaluate the reliability of C-tests in language proficiency assessment. Utilizing data from 150 participants…

This study presents a modified version of the Korean Elicited Imitation (EI) test, designed to resemble natural spoken language, and validates its reliability as a measure of proficiency. The study assesses the correlation between average test scores and Test of Proficiency in Korean (TOPIK) levels, examining score distributions among beginner,…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

Determining students' language proficiency is essential for successful instruction and learning objectives in many educational settings. To this end, one of the most efficient assessment tools for measuring language proficiency is the C-test. Thus, the primary aim of this research is to assess the performance of university students through the…

Released in 2018, China's Standards of English Language Ability (CSE) set a benchmark for language education and assessment in China, integrating with international standards. This study investigates whether CSE assessment literacy (understanding and applying CSE standards in assessment practice) enhances Language Assessment Literacy (LAL) among…

This study aimed to adapt the Plurilingual and Pluricultural Competence scale (PPC) to the Russian-speaking population and to assess its psychometric properties. Five hundred and sixty-four undergraduate students from Western, Central, and Caucasian regions of Russia and Kazakhstan participated in the study. Internal consistency, factorial,…

Purpose: The aim of this study was to develop a child self-report questionnaire measuring bilingual experience and self-perceptions of Spanish and English proficiency and establish preliminary evidence of validity and reliability for the questionnaire. Method: Participants included 113 Spanish-English bilingual children with and without…

Intercultural communication research has highlighted the significance of intercultural communication apprehension/anxiety measurement and instrument development in diverse sociocultural contexts. This study embarked on developing and validating a scale, the Perceived Intercultural Communication Anxiety/Apprehension Scale (PICAS) in the English as…

This study aimed to propose a new method for scoring C-Tests as measures of general language proficiency. In this approach, the unit of analysis is sentences rather than gaps or passages. That is, the gaps correctly reformulated in each sentence were aggregated as sentence score, and then each sentence was entered into the analysis as a polytomous…

Self-efficacy has emerged as a popular construct in second language research, especially in the frontline and practitioner-researcher spaces. A troubling trend in the relevant literature is that self-efficacy is often measured in a general or global manner. Such research ignores the fact that self-efficacy is a smaller context-driven construct…

Studies have shown that raising L2 learners' metaphor awareness contributes to the acquisition of figurative language, which fosters students' development of language skills. However, the instruments measuring metaphor awareness, in the majority of relevant research, did not seem to have undergone proper methodological procedures for checking…

The purpose of this study was to investigate the validity of the vocabulary subsection of a high-stakes university entrance exam for Ph.D. programs using the argument-based approach. All the three different versions of the test administered in a period of five years and the responses of 12,500 test-takers were studied. The study focused on four…

This article details the challenges and best practices of evaluating second language learners for placement into postsecondary Spanish language courses. The literature on testing for placement purposes in second language acquisition and language testing provides a great deal of insight, but language programs must make many decisions as well that…