A growing number of stakeholders argue for the use of second language (L2) speaking assessments that measure the ability to orally communicate in real time. A Web-based virtual environment (VE) that allows live voice communication among individuals may have potential for aiding in delivering such assessments. While off-the-shelf voice…

Differential Item Functioning (DIF) analysis is a key element in evaluating educational test fairness and validity. One of the frequently cited sources of construct-irrelevant variance is gender which has an important role in the university entrance exam; therefore, it causes bias and consequently undermines test validity. The present study aims…

Purpose: Relative lengths of the index (2D) and ring (4D) fingers in humans represent a retrospective biomarker of prenatal hormonal exposures. For this reason, the 2D:4D digit ratio can be used to investigate potential hormonal contributions to the etiology of neurodevelopmental disorders. This study tested potential group differences in 2D:4D…

Several previous factor-analytic studies on the construct validity of grammaticality judgment tests (GJTs) concluded that untimed GJTs measure explicit knowledge (EK) and timed GJTs measure implicit knowledge (IK) (Bowles, 2011; R. Ellis, 2005; R. Ellis & Loewen, 2007). It has also been shown that, irrespective of the time condition chosen,…

This study investigates the effects of sample size and test length on item-parameter estimation in test development utilizing three unidimensional dichotomous models of item response theory (IRT). For this purpose, a real language test comprised of 50 items was administered to 6,288 students. Data from this test was used to obtain data sets of…

The purpose of this study was to critically examine the absolute grading system applied to the English section of South Korea's College Scholastic Ability Test (CSAT), in a departure from a relative grading system, for the first time in 2017. English language instructors as well as English education researchers have somewhat differing…

Integrated speaking test tasks (integrated tasks) provide reading and/or listening input to serve as the basis for test-takers to formulate their oral responses. This study examined the influence of topical knowledge on integrated speaking test performance and compared independent speaking test performance and integrated speaking test performance…

Purpose: This study examined the effects of single-language and conceptual scoring on the vocabulary performance of bilingual children with and without specific language impairment. We assessed classification accuracy across 3 scoring methods. Method: Participants included Spanish-English bilingual children (N = 247) aged 5;1 (years;months) to…

Previous research has consistently demonstrated that false-belief (FB) understanding correlates with and predicts metalinguistic ability in preschoolers. Surprisingly, however, there is scant evidence on the question of whether this relation persists at later ages. The present cross-sectional study sought to fill this gap by examining the…

Language impairment often goes unidentified in students with behavioral disorders, perhaps in part because different forms of problem behavior deflect adult attention from more subtle language deficits. Therefore, attention to teachers' perception of students' language and behavioral performance is merited. The present study examines agreement…

The development of interactive multimedia CD-based teaching materials is urgent because the learning process in the Arabic Education Department is not 100% done as expected. This can be seen from some indicators that have not been achieved in the teaching and learning process. First, the lecturers teaching the same courses of Arabic language…

Developing a diagnostic tool within the diagnostic measurement framework is the optimal approach to obtain multidimensional and classification-based feedback on examinees. However, end users may seek to obtain diagnostic feedback from existing item responses to assessments that have been designed under either the classical test theory or item…

It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

Purpose: This article considers how the language performance of school-age children with language impairments, such as developmental language disorder, is influenced by the reciprocal relationship of existing linguistic knowledge and working memory resources and the resultant implications for assessment. Method: A viewpoint is provided by…

The Common European Framework of Reference for Languages (CEFR) is widely used in setting language proficiency requirements, including for international students seeking access to university courses taught in English. When different language examinations have been related to the CEFR, the process is claimed to help score users, such as university…