Listening comprehension in English, as one of the most fundamental skills, has an essential role in the process of learning English. Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to item response theory (IRT) which determines the one-dimensionality and scalability of test. Mokken scaling techniques are a useful tool for…

The current study aims to explore the cognitive validity of the iBT TOEFL reading test by investigating test takers' eye movements on individual items. It is assumed that successful test takers would adopt the intended reading processes, the same types and levels of cognitive processes that they would use for real-world reading tasks. Forty-seven…

Background: Validity is a notable concept in language testing which has concerned many researchers and scholars in the field of language testing due to its importance in decision making process. Tests' results always introduce consequences to test takers' lives which emphasizes the need to ensure their validity. Detecting and delineating the…

Background: This study aims to empirically answer the question of whether the role of sub-reading skills changes depending on the test format (e.g., multiple-choice vs. open-ended reading questions). The test format effect also addresses the issue of test validity--whether the reading test properly elicits construct-relevant reading skills or…

Background: This study examined the factor structure of the Test of English for Academic Purposes (TEAP®) test--a recently developed academic English test measuring four skills among Japanese university applicants--and compared the structure to that of the Test of English as a Foreign Language Internet-based test (TOEFL iBT®), to investigate the…

Almost no language test is void of grammar items, and the reason is probably the assumption that there exists a positive correlation between examinees' grammar knowledge and the actual demonstrable level of accuracy in communication. Meanwhile, examples abound where many examinees relatively do well on grammar knowledge tests despite failing to…