This study, conducted by two researchers who were also multiple-choice question (MCQ) test item writers at a private English-medium university in an English as a foreign language (EFL) context, was designed to shed light on the factors that influence test-takers' perceptions of difficulty in English for academic purposes (EAP) vocabulary, with the…

This paper presents an analysis of the gender of the authors and the main characters of the set texts for English examinations taken at age 16 in England, Northern Ireland, Scotland and Wales. It presents an argument for why representation within the canon is important and places this within the context of recent educational reform in England and…

For educational tests, it is critical to maintain consistency of score scales and to understand the sources of variation in score means over time. This practice helps to ensure that interpretations about test takers' abilities are comparable from one administration (or one form) to another. This study examines the consistency of reported scores…

A growing number of stakeholders argue for the use of second language (L2) speaking assessments that measure the ability to orally communicate in real time. A Web-based virtual environment (VE) that allows live voice communication among individuals may have potential for aiding in delivering such assessments. While off-the-shelf voice…

Differential Item Functioning (DIF) analysis is a key element in evaluating educational test fairness and validity. One of the frequently cited sources of construct-irrelevant variance is gender which has an important role in the university entrance exam; therefore, it causes bias and consequently undermines test validity. The present study aims…

Purpose: Relative lengths of the index (2D) and ring (4D) fingers in humans represent a retrospective biomarker of prenatal hormonal exposures. For this reason, the 2D:4D digit ratio can be used to investigate potential hormonal contributions to the etiology of neurodevelopmental disorders. This study tested potential group differences in 2D:4D…

Several previous factor-analytic studies on the construct validity of grammaticality judgment tests (GJTs) concluded that untimed GJTs measure explicit knowledge (EK) and timed GJTs measure implicit knowledge (IK) (Bowles, 2011; R. Ellis, 2005; R. Ellis & Loewen, 2007). It has also been shown that, irrespective of the time condition chosen,…

This study investigates the effects of sample size and test length on item-parameter estimation in test development utilizing three unidimensional dichotomous models of item response theory (IRT). For this purpose, a real language test comprised of 50 items was administered to 6,288 students. Data from this test was used to obtain data sets of…

The purpose of this study was to critically examine the absolute grading system applied to the English section of South Korea's College Scholastic Ability Test (CSAT), in a departure from a relative grading system, for the first time in 2017. English language instructors as well as English education researchers have somewhat differing…

Integrated speaking test tasks (integrated tasks) provide reading and/or listening input to serve as the basis for test-takers to formulate their oral responses. This study examined the influence of topical knowledge on integrated speaking test performance and compared independent speaking test performance and integrated speaking test performance…

Purpose: This study examined the effects of single-language and conceptual scoring on the vocabulary performance of bilingual children with and without specific language impairment. We assessed classification accuracy across 3 scoring methods. Method: Participants included Spanish-English bilingual children (N = 247) aged 5;1 (years;months) to…

Previous research has consistently demonstrated that false-belief (FB) understanding correlates with and predicts metalinguistic ability in preschoolers. Surprisingly, however, there is scant evidence on the question of whether this relation persists at later ages. The present cross-sectional study sought to fill this gap by examining the…

Language impairment often goes unidentified in students with behavioral disorders, perhaps in part because different forms of problem behavior deflect adult attention from more subtle language deficits. Therefore, attention to teachers' perception of students' language and behavioral performance is merited. The present study examines agreement…

The development of interactive multimedia CD-based teaching materials is urgent because the learning process in the Arabic Education Department is not 100% done as expected. This can be seen from some indicators that have not been achieved in the teaching and learning process. First, the lecturers teaching the same courses of Arabic language…

Developing a diagnostic tool within the diagnostic measurement framework is the optimal approach to obtain multidimensional and classification-based feedback on examinees. However, end users may seek to obtain diagnostic feedback from existing item responses to assessments that have been designed under either the classical test theory or item…