This article compares two methods for detecting local item dependence (LID): residual correlation examination and Rasch testlet modeling (RTM), in a commonly used 3:6 matching format and an extended matching test (EMT) format. The two formats are hypothesized to facilitate different levels of item dependency due to differences in the number of…

This study presents a comparative analysis of classical reliability measures, including Cronbach's alpha, test-retest, and parallel forms reliability, alongside modern psychometric methods such as the Rasch model and Mokken scaling, to evaluate the reliability of C-tests in language proficiency assessment. Utilizing data from 150 participants…

Determining students' language proficiency is essential for successful instruction and learning objectives in many educational settings. To this end, one of the most efficient assessment tools for measuring language proficiency is the C-test. Thus, the primary aim of this research is to assess the performance of university students through the…

This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview - Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an…

Cloze tests are commonly used in language testing as a quick measure of overall language ability or reading comprehension. A problem for the analysis of cloze tests with item response theory models is that cloze test items are locally dependent. This leads to the violation of the conditional or local independence assumption of IRT models. In this…

Artificial Intelligence (AI) is growing -- as can be clearly observed not only from the rising recognition of assistance tools such as Siri (Apple) but also from the newly introduced Google Voiced Translator. Yet, some crucial benchmarks still have to be supplied before it can act as a proxy for a real instructor: imagination, creativity, and…

In response to the high demand for English proficiency exams for various purposes including placement, admission, certification, and program evaluation in Mexico, a university in Western Mexico created the English Proficiency Test (EPT) for the B1 level in the Common European Framework of Reference (CEFR). The EPT has been developed and piloted…

This article aims to give a comprehensive guide to planning and designing vocabulary tests which include Identifying the skills to be covered by the test; outlining the course content covered; preparing a table of specifications that shows the skill, content topics and number of questions allocated to each; and preparing the test instructions. The…

Purpose: Intercultural communicative competence (ICC) is important in intercultural exchange, to address problems and conflicts which may arise due to miscommunication that results from interlocutors' diverse cultural and linguistic backgrounds. Interlocutors may have different perceptions and interpretations of communicative behaviour. However,…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

Classroom practices, materials and teaching methods in language classes have changed a lot in the last decades and continue to evolve; however, the commonly used techniques to test students' foreign language skills have not changed much regardless of the recent awareness in Bloom's taxonomy. Testing units at schools rely mostly on multiple choice…

Placement testing is a crucial issue in Japanese universities. In the majority of language programs, classes are streamed by proficiency levels based on students' placement test score for efficient instruction because university students' proficiency levels vary greatly even in the same program. The Visualizing English Language Competency Test®…

There is a strong international demand for official certification of French competence. A range of tests are available to meet this goal. Among the recognized tests available for this purpose is the "DELF" ("Diplôme d'études en langue française"). The "DELF" has been awarded the Association of Language Testers in…

Most language proficiency exams in Europe are presently developed so that reported scores can be related to the "Common European Framework of Reference for Languages" (CEFR; (Council of Europe. 2001. "Common European framework of reference for languages: learning, teaching, assessment." Cambridge: Cambridge University Press.).…

Test impact, widely recognized as the influence of testing on learning and teaching, affects a set of stakeholders including test takers. This study defines the construct of test impact on test takers and describes the construction and validation of the scale of test impact on test takers (TITT). 410 participants having passed a language test in…