Background: Variations in the skill profiles of learners have become an important research area in recent years. However, there is a lack of empirical research on this topic in Japan. We conducted three studies to address this gap. Methods: Study 1 investigated the characteristics of the flat and uneven skill profiles of Japanese learners of…

This study employs eye-tracking to investigate how first (L1) and second language (L2) glosses affect lexical uptake and reading behaviors in L2 learners of English. The study also explores the relationship between lexical uptake and reading behaviors as a function of gloss type. To investigate this, 81 Korean university students were asked to…

As compared to traditional modes of delivery, cooperative learning (CL), as a teaching method, is said to be effective in improving learners' academic achievement. A plethora of studies underscore CL as a strategy of instruction that delivers improvement in learning outcomes. However, not many of the studies consider the role of CL in facilitating…

To better understand the relationship between second-language (L2) listening comprehension and metacognitive awareness, we examined the moderating effects of listening tests and learner samples while focusing on aspects of metacognitive awareness. Students of English-as-a-foreign-language at a Japanese university (n = 75; the 2019 cohort) took the…

The factors that influence rater scoring have been a subject of great interest to researchers in second language assessment. However, the research on the impact of test-takers' speech profiles (e.g., a jagged or a flat profile reflecting analytic subscores) on raters' scoring behaviors remains to be seen. To investigate the role of speech profiles…

Language learners are underserved if there are unlearned meanings of a word that they think they have already learned. For example, "circle" as a noun is well known, whereas its use as a verb is not. For artificial-intelligence-based support systems for learning vocabulary, assessing each learner's knowledge of such atypical but common…

The study aimed to determine the English proficiency and literary competence of English major students of CBSUA-Sipocot. The third and fourth-year college students were the respondents of the study. The evaluative-correlational method was employed in the research. Frequency count and percentage technique were used to describe levels of proficiency…

Purpose: In this letter, the authors respond to Pavelko and Owens' (2017) newly advanced set of procedures for language sample analysis: Sampling Utterances and Grammatical Analysis Revised (SUGAR). Method: The authors contrast some of the new guidelines for transcription, morpheme segmentation, and language sample elicitation in SUGAR with…

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

Educational assessment data are often collected from a set of test centers across various geographic regions, and therefore the data samples contain clusters. Such cluster-based data may result in clustering effects in variance estimation. However, in many grouped jackknife variance estimation applications, jackknife groups are often formed by a…

This study is a literature review on the findings of different studies on the dimensionality of language proficiency. It aims to particularly analyze the assumptions and the statistical findings of relevant research since it has always been an endless debate among linguists and language teachers about whether language proficiency is organized as a…

The history of vocabulary research has specified a rich and complex construct, resulting in calls for vocabulary research, assessment, and instruction to take into account the complex problem space of vocabulary. At the intersection of vocabulary theory and assessment modeling, this paper suggests a suite of modeling techniques that model the…

Vocabulary learning is an incremental process. Vocabulary knowledge, especially for second-language learners, may develop across a lifetime. Teachers with experience in providing feedback on their students' vocabulary use in writing or speech might have noticed that it is sometimes difficult to pinpoint one aspect of word knowledge. The reason is…

This article analyzes the results of the Saber Pro, the state exam for students completing higher education, during 2007-2017 concerning the English language section. This analysis uses the reports and databases from the Instituto Colombiano para la Evaluación de la Educación (ICFES) repository and explains the policy in its historical context.…