This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

'Grit' has been identified as an important predictor of success in a number of academic and non-academic domains (Duckworth, A. L., C. Peterson, M. D. Matthews, and D. R. Kelly. 2007. "Grit: Perseverance and Passion for Long-Term Goals." "Journal of Personality and Social Psychology" 92: 1087-1101.…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

Background: Research on the test-taker perception of assessments has been conducted under the assumption that negative test-taker perception may influence test performance by decreasing test-taking motivation. This assumption, however, has not been verified in the field of language testing. Building on expectancy-value theory, this study explored…

We examined the factorial structure and validity of a Japanese version of the Parental Burnout Assessment, the PBA-J, with 1,500 Japanese parents. The Parental Burnout Assessment measures burnout using four dimensions: exhaustion in one's parental role, contrast in parental self, feelings of being fed up, and emotional distancing. Confirmatory…

This paper conducts a theoretical examination of an evidence-based approach (EBA) to research on language policy and language-in-education policy (LPLEP), as well as a methodological examination of the feasibility of evidence-based LPLEP research based on actual studies. Theoretical scrutiny, based on EBA's core concepts--evidence hierarchy,…

The main purpose of this study is to hypothesize the existence of the general sense of role satisfaction and device a scale to measure it. The participants in study 1 were 1029 Japanese high school students (484 men and 545 women). The result of exploratory factor analysis suggested that the two-factor structure is adequate. One is "social…

The universality of secure base construct, which suggests that one's use of an attachment figure as a secure base from which to explore the environment is an evolutionary outcome, is one of the core ideas of attachment theory. However, this universality idea has been critiqued because exploration is not as valued in Japanese culture as it is in…

Individual differences are theorised as being key predictors of students' lecture attendance. Understanding students' (lack of) motivation for studying is an essential first step in supporting these individual differences and potentially increasing class/lecture attendance. The current study explored the role of students' deficits in motivations…

It is common practice for K-12 schools to assess multilingual students' language proficiency to determine language support program placement. Because such programs can provide essential scaffolding, the policies guiding these assessments merit careful consideration. It is well accepted that quality assessments must be valid (representative of the…

Teaching style has been a popular concept for many years. Teaching style refers to the distinct qualities displayed by a teacher that are persistent from situation to situation regardless of the content. The Principles of Adult Learning Scale (PALS) has been used extensively in the West for measuring teaching style in relationship to the adult…

This study assessed the factor structure of the Test of English for International Communication (TOEIC®) Listening and Reading test, and its invariance across subgroups of test-takers. The subgroups were defined by (a) gender, (b) age, (c) employment status, (d) time spent studying English, and (e) having lived in a country where English is the…

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of…

The purpose of this study is to validate the widely adopted Teachers' Sense of Efficacy Scale (TSES) for the East Asian context. The researchers seek to find out whether TSES holds validity and reliability and is appropriate for use to measure teacher efficacy in China, Korea, and Japan. 489 teachers from the three countries participated in the…

This study compared three common vocabulary test formats, the Yes/No test, the Vocabulary Knowledge Scale (VKS), and the Vocabulary Levels Test (VLT), as measures of vocabulary difficulty. Vocabulary difficulty was defined as the item difficulty estimated through Item Response Theory (IRT) analysis. Three tests were given to 165 Japanese students,…