Measuring similarity of educational items has several applications in the development of adaptive learning systems, and previous research has already proposed a wide range of similarity measures. In this work, we provide an experimental evaluation of selected similarity measures using a large dataset. The used items are alternate-choice questions…

Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a…

Testing of previously studied information potentiates subsequent learning of new information, a phenomenon referred to as the "forward testing effect" (FTE). The current study aimed to investigate the developmental trajectory of the FTE and whether the reset-of-encoding process contributes to the FTE. Younger children, older children,…

Scoring language learners' speaking skills is open to a number of measurement errors since raters' personal judgements could involve in the process. Different grading designs in which raters score a student's whole speaking skills or a specific dimension of the speaking performance could be settled to control and minimize the amount of the error…

This study, taking into consideration of teachers' as well as students' judgments, explored the generalizability and consistency of the results of linking speaking test of IELTS to China's Standards of English Language Ability (CSE). Nine college English teachers and 81 undergraduate students judged the degree of congruence between the IELTS…

In contrast to the large body of research investigating intervention for poor decoding skills, far fewer studies have evaluated interventions for reading comprehension. There is even less research on children with more specific difficulties with reading comprehension, often referred to as "poor comprehenders". Levels of effectiveness…

This study aimed to compare selection patterns of distractors (incorrect options) according to test taker proficiency regarding Japanese students' summarization skills of an English paragraph. Participants included 414 undergraduate students, and the test comprised three summarization process types--deletion, generalization, and integration.…

Recent studies have proposed developments to the Simple View of Reading to reflect reading development across age groups and differences among learner profiles and account for additional factors that explain reading comprehension performance beyond word recognition and language comprehension. One of these proposals is the inclusion of cognitive…

English teachers, especially those who teach summary writing to students with relatively lower proficiency in English face difficulty in teaching summary writing and while assessing their students' performances. In the classroom context, an analytic rubric is pedagogically more helpful than a holistic rubric because the teacher can confirm the…

Summative assessment of interpretation is widely conducted in interpreting courses/programs to inform high-stakes decision making, such as the selection, certification, and conferral of academic degrees. Yet there has been very limited empirical research to investigate the score dependability of summative interpretation assessment. The present…

The recorded text test (RTT) is commonly used to test dialect intelligibility, often to inform language development decisions. More than 25 papers using the RTT method were published on www.sil.org/silesr from January 2009 to March 2013. As introduced by Casad [1974. "Dialect Intelligibility Testing." Summer Institute of Linguistics…

This article provides preliminary validity evidence for the shorter Mandarin version of the Vocabulary Size Test (VST) under the content aspect, technical quality, substantive and generalizability aspect of Messick's (1995) construct validity framework. The shorter version with 177 Chinese university students in three proficiency levels indicates…

In the present study, aspects of the measurement of writing are disentangled in order to investigate the validity of inferences made on the basis of writing performance and to describe implications for the assessment of writing. To include genre as a facet in the measurement, we obtained writing scores of 12 texts in four different genres for each…

A large body studies into individual differences in second language learning has shown that success in second language learning is strongly affected by a set of relevant learner characteristics ranging from the age of onset to motivation, aptitude, and personality. Most studies have concentrated on a limited number of learner characteristics and…

Despite many years of investigation into implicit learning in nonlinguistic domains, the potential for implicit learning to deliver the kinds of generalizations that underlie natural language competence remains unclear. In a series of experiments, we investigated implicit learning of the semantic preferences of novel verbs, specifically, whether…