This study aimed to adapt the Plurilingual and Pluricultural Competence scale (PPC) to the Russian-speaking population and to assess its psychometric properties. Five hundred and sixty-four undergraduate students from Western, Central, and Caucasian regions of Russia and Kazakhstan participated in the study. Internal consistency, factorial,…

Background: This study investigated the scoring and criterion-related validity of the TEAP, a newly developed Test of English for Academic Purposes. In this study, scoring validity was examined by investigating the factor structure, while criterion-related validity was examined by first investigating the longitudinal change of test takers'…

Purpose: The present study investigated the domain-specificity of language mindset with a focus on foreign language (L2) reading mindset. We further examined whether L2 reading mindset could predict several L2 reading-specific outcomes, including L2 reading achievement and L2 reading emotions above and beyond general language mindset.…

Rasch testlet and bifactor models are two measurement models that could deal with local item dependency (LID) in assessing the dimensionality of reading comprehension testlets. This study aimed to apply the measurement models to real item response data of the Iranian EFL reading comprehension tests and compare the validity of the bifactor models…

Inferencing skills uniquely contribute to the reading comprehension skills of older grade-school and college students. Evidence also suggests that children's reading component skills, such as decoding and language comprehension, differentially contribute to various reading comprehension assessments. However, additional research is needed to…

Purpose: The validity of any performance assessment depends substantially on the rating scale used in the assessment procedure. It delineates the theoretical construct being measured and influences how performances are judged and interpreted. This study examined the factorial validity and invariance of the rating scale used for the assessment of…

This study investigated the construct validity of a local speaking test for international teaching assistants (ITAs) from a fairness perspective, by employing a multi-group confirmatory factor analysis (CFA) to examine the impact of task type and examinee first language (L1) background on the internal structure of the test. The test consists of…

Test impact, widely recognized as the influence of testing on learning and teaching, affects a set of stakeholders including test takers. This study defines the construct of test impact on test takers and describes the construction and validation of the scale of test impact on test takers (TITT). 410 participants having passed a language test in…

Background: This study investigated the factor structure and factorial invariance of an English Placement Exam (EPE) from 1998 to 2011 to provide evidence for both the appropriateness of the test scores interpretations and for a validity argument. Methods: Test performance data collected from 38,632 freshmen non-English majors from a university in…

The first aim of this study was to develop a computer adaptive EFL test (CALT) that assesses test takers' listening and reading proficiency in English with dichotomous items and polytomous testlets. We reported in detail on the development of the CALT, including item banking, determination of suitable item response theory (IRT) models for item…

The name "SAT" has become synonymous with college admissions testing; it has been dubbed "the gold standard." Numerous studies on its reliability and predictive validity show that the SAT predicts college performance beyond high school grade point average. Surprisingly, studies of the factorial structure of the current version…

The present inquiry inspected the impact of metacognitive awareness on the fluency of 114 Iranian TEFL learners' task-based oral output. The participants in six intact classes were selected from a population of 120 English sophomores based on their scores on proficiency pre-test. The classes were randomly assigned as two tripartite groups of…

One of the fundamental problems in language testing is the lack of adequate generalizability between what a test is measuring and what fulfills the learners' real world language use needs. It is important to recognize that no matter how precise a test measures a construct, if the way that a construct is defined and the way that test tasks are…

This study compares two approaches to grammatical knowledge in language assessment: the structural view that regards grammatical knowledge as vocabulary and syntax (Bachman 1990), and the communicative view that perceives it as the binary combination of grammatical form and meaning (Purpura 2004). 1,491 second-year nursing students from eight…

This study examined the construct validity of the TOEFL iBT Speaking subsection for the purposes of international teaching assistant (ITA) certification, a purpose for which it was not specifically designed. The factor structure of the new TOEFL was compared with that of another language performance test in use at a major American research…