This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses…

This study aimed to examine the effect of test format on test performance by comparing Multiple Choice (MC) and Constructed Response (CR) vocabulary tests in an EFL setting. Also, this paper investigated the function of gender in MC and CR vocabulary measures. To this end, five 20-item stem-equivalent vocabulary tests (CR, and 3-, 4-, 5-, and…

The present study addresses a significant but neglected aspect of vocabulary teaching in general and teaching collocations, in particular, which is color term collocations. A significant number of idioms involve use color terms such as blue blood, black death, red tape, black sheep, and yellow press that are significant to study in the context of…

Effective listening comprehension skills are an important prerequisite for the academic success of primary school students. However, the assessment of listening skills in the instructional language appears to have received only scant attention in the literature. Therefore, the goal of the present study was twofold. Firstly, a comprehensive…

Classroom practices, materials and teaching methods in language classes have changed a lot in the last decades and continue to evolve; however, the commonly used techniques to test students' foreign language skills have not changed much regardless of the recent awareness in Bloom's taxonomy. Testing units at schools rely mostly on multiple choice…

This study investigates the impact that study in Australia has on the lexical knowledge of Saudi Arabian students. It focuses on: 1) the effects that the length of study in Australia has on the acquisition of lexical collocations, as reflected by lexical knowledge tests, and 2) whether there is a significant gender difference in the acquisition of…

The present study aimed at investigating the effect of an instructional program on vocational educational students' proficiency of vocational educational terms in English. The study sample consisted of 60 male and female students from Al-Balqa'a Applied University, Jordan. Moreover, the study investigated the effect the students' gender and…

This study investigated the role of item formats in the performance of 206 nonnative speakers of English on expressive skills (i.e., speaking and writing). Test scores were drawn from the field test of the "Pearson Test of English Academic" for Chinese, French, Hebrew, and Korean native speakers. Four item formats, including…

The present study utilizes readings taken from texts in social psychology to examine the effects by gender of embedded "what" questions and elaborative "why" questions on reading comprehension. During regular class time, 97 advanced second language (L2) learners of Spanish read two different vignettes, either with or without…

Validity, reliability and item analysis are critical to the process of evaluating the quality of an educational measurement. The present study evaluates the quality of an assessment constructed to measure elementary school student's achievement in English. In this study, the survey model of descriptive research was used as a research method.…

This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple-choice (MC) item anchor in mixed-format tests, which include both MC and constructed-response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC-only anchor set for 4…

This article investigates a version of the International English Language Testing System (IELTS) listening test for evidence of differential item functioning (DIF) based on gender, nationality, age, and degree of previous exposure to the test. Overall, the listening construct was found to be underrepresented, which is probably an important cause…

This study investigated the relative frequency of seven TW strategies among Iranian EFL students to find out probable relationship(s) between test-wiseness, proficiency and gender. To do so, out of 138 participants, a total number of 80 undergraduate EFL students from Shahid Chamran University were chosen and divided on the basis of their…

This study examined scores from 133,906 operationally scored Test of English as a Foreign Language™ (TOEFL®) essays to determine whether the choice of composition medium has any impact on score quality for subgroups of test-takers. Results of analyses demonstrate that (a) scores assigned to word-processed essays are slightly more reliable than…