This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on…

Background: Research on the test-taker perception of assessments has been conducted under the assumption that negative test-taker perception may influence test performance by decreasing test-taking motivation. This assumption, however, has not been verified in the field of language testing. Building on expectancy-value theory, this study explored…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

The main purpose of this study is to hypothesize the existence of the general sense of role satisfaction and device a scale to measure it. The participants in study 1 were 1029 Japanese high school students (484 men and 545 women). The result of exploratory factor analysis suggested that the two-factor structure is adequate. One is "social…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

Standardized testing is ubiquitous in Japan. Inexpensive and easily mass distributed, their use has been encouraged at every level of the education system. Over the past thirty years, external testing agencies have been increasingly relied upon to make standardized tests for use as benchmarks in the education system and in the private sector.…

This paper examines how different test methods may tap different aspects of second language knowledge. It employs multiple-choice (MC) and constructed response (CR) items which yield distinct or convergent information in the computer delivered testing of English in its presentation of this factor. In order to examine the effects of test method, a…

This article describes the National Center Test for University Admissions, a unified national test in Japan, which is taken by 500,000 students every year. It states that implementation of the Center Test began in 1990, with the English component consisting only of the written section until 2005, when the listening section was first implemented…

Test takers should have a voice in testing practices (Mathew, 2004). However, when incorporating their input, systematic processes to ensure the validity of testing practices must be followed. Such processes allow for test development to be a more democratic process (Shohamy, 2001), without sacrificing the value of the resulting inferences made…

The aim of the 2018 International Association for Development of the Information Society (IADIS) Cognition and Exploratory Learning in the Digital Age (CELDA) conference was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There have been advances in both cognitive…

An investigation of the cross-cultural validity of the femininity (Fe) scale in samples of 300 male and 300 female Japanese university students found that 30 of the 38 items differentiated in the same direction as in the original U.S. studies and also that the total score on the scale gave good separation between the Japanese males and females.…

This article investigates a group oral test as administered at a university in Japan to find if it is appropriate to use scores for higher stakes decision making. It is one component of an in-house English proficiency test used for placing students, evaluating their progress, and making informed decisions for the development of the English…

This document is an English-language abstract (approximately 1,500 words) of a series of research papers on the selection of college and university students. One paper compared the scores gained by three different types of entrants to six universities attracting applicants of high quality. It was found that a candidate has almost no chance of…

A study undertaken in Japan investigated the degree to which students' use of English as a Second Language in journal writing outside of class corresponded to their performance on language tests. Specifically, the correct use of articles in the position and function of "a, an, and the" was examined. Subjects were students in a secondary…

This paper examines both overseas and domestic tests of English speaking ability from the viewpoint of the crucial testing elements such as definition of speaking ability, validity, reliability, and practicality. The paper points out problems to be solved and proposes suggestions for constructing an oral proficiency test in order to determine the…