This research aims to compare the ability and item parameter estimations of Item Response Theory according to Maximum likelihood and Bayesian approaches in different Monte Carlo simulation conditions. For this purpose, depending on the changes in the priori distribution type, sample size, test length, and logistics model, the ability and item…

In Comparative Judgement (CJ) exercises, examiners are asked to look at a selection of candidate scripts (with marks removed) and order them in terms of which they believe display the best quality. By including scripts from different examination sessions, the results of these exercises can be used to help with maintaining standards. Results from…

Comparing language tests and test preparation materials holds important implications for the latter's validity and reliability. However, not enough studies compare such materials across a wide range of indices. Therefore, this study investigated the text complexity of IELTS academic reading tests (IRT) and IELTS reading practice tests (IRPrT).…

Any body of research evolves over time. Previous understandings become more nuanced, ideas are supported or rebuked, and, eventually we arrive at a clearer view of the issue. The research on score comparability across computerized devices is no exception. CCSSO [Council of Chief State School Officers] and the Center for Assessment have published…

Evidence of comparability is generally needed whenever there are variations in the conditions of an assessment administration, including variations introduced by the administration of an assessment on multiple digital devices (e.g., tablet, laptop, desktop). This article is meant to provide a comprehensive examination of issues relevant to the…

The public understanding of science is a term now considered somewhat narrow and carrying connotations of a "deficit model" of the public. Since the late 1980s, however, regular public surveys have been conducted to find out what facts about science the public knows. These include such questions as whether the Earth goes round the Sun,…

Reviews information about three major dimensions along which phonics measures vary: (1) group v individual administration, (2) production response (say or write) v recognition response, and (3) the stimuli or materials used to evaluate phonics. (HOD)

Argues that, in determining if a standardized test task and a classroom performance task are the same, educators should carefully analyze the tasks in terms of the input modality (stimulus) and the output modality (response). (FL)

This paper discusses recent developments in language testing. It begins with a review of the traditional criteria that are applied to all measurement and outlines recent emphases that derive from the expanding range of stakeholders. Drawing on Alderson's seminal work, criteria are presented for evaluating communicative language tests. Developments…

A meta-analysis was conducted of 107 classroom and laboratory studies concerning the effects of expecting a recall, recognition, essay, multiple-choice, or true-false test on students' subsequent achievement. Laboratory studies did not generalize well to classrooms. In classroom studies, subjects performed better when they knew which test type to…

The verbal item types of the Graduate Record Examinations (GRE) were studied to explore possible reasons for any differences found in subgroup performance and validity. Statistical differences among item types in active forms of the GRE verbal measure were documented; experimental subtests of matching statistical characteristics for the item types…

A review of the literature on a variety of issues related to testing vocabulary knowledge in a second language addresses these topics: problems in estimating vocabulary size, including the related questions of what constitutes a word, how a sample should be selected, and what are the criteria for knowing a word; sampling the basic and specialized…