In language assessment, AI technology has been incorporated in task design, assessment delivery, automated scoring of performance-based tasks, score reporting, and provision of feedback. AI technology is also used for collecting and analyzing performance data in language assessment validation. Research has been conducted to investigate the…

Testlets bring several perks in the development and administration of tests, such as 1) the construction of meaningful test items, 2) the avoidance of non-relevant context exposure, 3) the improvement of testing efficiency, and 4) the progression of testlet items requiring higher thinking skills. Thus, the inclusion of testlets in educational…

Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies…

This reflection paper disseminates the design and implementation of an English placement test for first semester students from different majors. This design was carried out within the framework of a research project in a Colombian public university. The article has a twofold purpose: to scrutinize the stages leading to a test, and to highlight the…

This article discusses a range of current issues and future research possibilities in Communicative Language Testing (CLT) using, as its departure point, the key questions which emerged during the CLT symposium at the 2010 Language Testing Forum. The article begins with a summary of the 2010 symposium discussion in which three main issues related…

This study examined the underlying constructs measured by the Woodcock-Johnson Tests of Cognitive Abilities, Third Edition (WJ-III COG) and the Stanford-Binet Intelligence Scales, Fifth Edition (SB5), based on the Cattell-Horn-Carrol (CHC) theory of cognitive abilities. This study reports the results of the first joint confirmatory factor analysis…

In conducting this review, we examine literature that explores the merits and shortcomings of ELP test design and testing as they have evolved over time through the current era of CCR standards. In the first section, we situate the role of language testing in its broader historical and policy context. In the second section, we examine the evolving…

The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

This paper reviews the progress made in washback studies over the quarter century since Hughes' (1989) placed it at the centre of his textbook "Testing for Language Teachers." Research into washback and the development of models of washback are described and an agenda is suggested for test developers wishing to build washback into…

Implications of the International Classification of Functioning, Disability and Health (ICF) on the development and use of tests in school settings are enumerated. We predict increased demand for behavioural assessments that consider a person's activities, participation and person-environment interactions, including measures that: (a) address…

The authors center their presentation of material around a conceptual understanding of psychometric issues, such as validity and reliability, and on purpose rather than procedure, the "why" rather than the "how to." Their goal is to introduce psychometric principles at a level that is deeper and more focused than found in introductory…

The Internet has opened up a whole new set of opportunities for advancing the science of psychometrics and the technology of testing. It has also created some new challenges for those of us involved in test design and testing. In particular, we are seeing impacts from internationalization of testing and new models for test delivery. These are…

Certain modifications of a conventional test are proposed which force the item difficulty level to adjust automatically to the ability level of the examinee. The modified test is called a flexilevel test. Although different examinees take different sets of items, the scoring method provides comparable scores for all. Furthermore, the test is…