With Russian as the target language, a proof of concept study was undertaken to determine whether it is possible to identify linguistic features, control over which is implicated in progress on the Interagency Linguistic Roundtable (ILR) proficiency scale, thereby better to inform the instructional process. Following its development in an…

This study tracked gender differential item functioning (DIF) on the English subtest of the Korean College Scholastic Aptitude Test (KCSAT) over a nine-year period across three data points, using both the Mantel-Haenszel (MH) and item response theory likelihood ratio (IRT-LR) procedures. Further, the study identified two factors (i.e. reading…

There is an increasing sensitivity to the challenges posed by the language of examination papers and of instruction in scientific subjects, especially for non-native speakers of English. It has been observed that in addition to technical subject-specific vocabulary, non-technical words such as instructional verbs have been sources of difficulty,…

This study examines the associations between the speaking proficiency of 181 adult learners of Dutch as a second language and their linguistic competences. Performance in eight speaking tasks was rated on a scale of communicative adequacy. After extrapolation of these ratings to the Overall Oral Production scale of the Common European Framework of…

This study examined whether the observed effectiveness of recasts is influenced by the type of outcome measure used and whether different aspects of working memory are differentially associated with learners' performance on the various outcome measures. The participants were 90 learners of English as a foreign language, who were randomly assigned…

The purpose of research described in the current study is the psychological reliability, its importance, application, and more to investigate on the impact analysis of psychological reliability of population pilot study for selection of particular reliable multi-choice item test in foreign language research work. The population for subject…

This paper investigates the impact of content validity of language tests on both teacher and learner. Educational evaluation produces too much stress in both teacher and learner, but it is given less attention by the teacher than any other teaching tasks. This inconvenience comes from the doubt with which this topic is approached. Tests are…

The history of the evolution of language assessments for children and adults with language disorders is described briefly. This is followed by a discussion on language assessment of the clinical population with an emphasis on linguistic profiling, illustrated through the Linguistic Profile Test. Discourse analysis, in particular, is highlighted…

This study adopted a multilevel modeling (MLM) approach to examine the contribution of rater and essay factors to variability in ESL essay holistic scores. Previous research aiming to explain variability in essay holistic scores has focused on either rater or essay factors. The few studies that have examined the contribution of more than one…

Analysis of children's productions of oral narratives provides a rich description of children's oral language skills. However, measures of narrative organization can be directly affected by both developmental and task-based performance constraints which can make a measure insensitive and inappropriate for a particular population and/or sampling…

This article is based upon a presentation given at the Language Testing Research Colloquium (LTRC) held in Denver, Colorado, in March 2009. That presentation reviewed some of the recent attempts from within our research community to "tell the story" of our field over several decades. It explored how the discourse of these narratives contributes to…

This article discusses a case study on an item writing process that reflects on our practical experience in an item development project. The purpose of the article is to share our lessons from the experience aiming to demystify item writing process. The study investigated three issues that naturally emerged during the project: how item writers use…

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to…

This study investigated whether scores obtained from the online and paper-and-pencil administrations of the statewide end-of-course English test were equivalent for students with and without disabilities. Score comparability was evaluated by examining equivalence of factor structure (measurement invariance) and differential item and bundle…

The aim of this research is to determine differential item functioning (DIF) by hierarchical linear modeling (HGLM) on test items and comparing these results by the DIF results determined by logistic regression (LR) and IRT-likelihood ratio (IRT-LR) techniques. Investigating the concordance between the techniques in determining the items with DIF,…