Standard-setting is an essential component of test development, supporting the meaningfulness and appropriate interpretation of test scores. However, in the high-stakes testing environment of aviation, standard-setting studies are underexplored. To address this gap, we document two stages in the standard-setting procedures for the Overseas Flight…

This study aimed to develop a Vietnamese word recognition test for Taiwanese undergraduate students and to investigate students' performances at different learning stages. The formal test consists of 100 words as test items. With each word, test takers were asked to select the correct Vietnamese word form corresponding to the pronunciation they…

Purpose: Many language tests use different versions that are not statistically linked or do not have a developmental scaled score. The current article illustrates the problems of scores that are not linked or equated, followed by a statistical model to derive a developmental scaled score. Method: Using an accelerated cohort design of 890 students…

This special issue brings together research in multilingualism within applied linguistics to delineate conceptualizations of multilingualism as constructs amenable for classroom and standardized testing systems operations. Specifically, for language testing and assessment, there have been multiple calls for the field to embrace multilingual…

Exploratory cognitive diagnosis models (CDMs) estimate the Q matrix, which is a binary matrix that indicates the attributes needed for affirmative responses to each item. Estimation of Q is an important next step for improving classifications and broadening application of CDMs. Prior research primarily focused on an exploratory version of the…

Purpose: Spoken language sample analysis (LSA) is widely considered to be a critical component of assessment for child language disorders. It is our best window into a preschool child's everyday expressive communicative skills. However, historically, the process can be cumbersome, and reference values against which LSA findings can be…

This study investigated preschoolers' knowledge of Chinese characters by testing character structures on four levels: radical (character components), whole characters, characters in words and characters in sentences. A total of 107 preschool children between the ages of three and six from four nursery schools in Taiwan participated in the study.…

There is a growing need for standardized oral assessment rubrics in learning institutions. This is linked to the growing number of ESL learners not only in Saudi Arabia but other parts of the world. To assess the need to use standardized oral assessment rubrics, this particular study explores various peer reviewed articles that support the use of…

One of the biggest challenges for EFL (English as Foreign Language) students to learn English is the lack of practicing environments. Although language researchers have attempted to conduct flipped classrooms to increase the practicing time in class, EFL students generally have difficulties interacting with peers and teachers in English in class.…

This paper aims to validate the English Language Entrance Test for King Saud bin Abdulaziz University for Health Science (hereafter KSAU-ET). It supports the argument regarding using specially designed in-house entrance tests at health universities by showcasing the test's development, administration, and validation process. It presents a new…

This meta-analysis explores the correlation between self-assessment (SA) and language performance. Sixty-seven studies with 97 independent samples involving more than 68,500 participants were included in our analysis. It was found that the overall correlation between SA and language performance was 0.466 (p < 0.01). Moderator analysis was…

The present research investigates the effect of self-regulatory strategy instruction on Iranian EFL learners' metadiscoursal writing abilities. To this purpose, 50 Iranian EFL intermediate learners were all native speakers of the Persian language learning the English language in an institute were selected via convenience random sampling.…

Research employing psycholinguistic techniques to assess the on-line processing of collocation by native and non-native speakers has flourished in the past few years. This line of research aims (among other things) at exploring actual performance in real time as opposed to the traditional paper-and-pencil testing techniques that have been…

Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues…