The purpose of this study was to apply two types of Differential Item Functioning (DIF), net and global DIF, as well as the framework of Differential Step Functioning (DSF) to real testing data to investigate measurement invariance related to test language. Data from the Program for International Student Assessment (PISA)-2006 polytomously scored…

In view of the strengthening momentum in efforts to reforms in examinations in higher education of India and Kerala in particular, and holding that teacher education is in privileged position to initiate examination reforms in higher education by virtue of its link with both school education and the higher education, this paper focuses attention…

A total of 19 graduate students enrolled in a graduate course conducted 6 consecutive administrations of the Wechsler Intelligence Scale for Children, 4th edition (WISC-IV, Canadian version). Test protocols were examined to obtain data describing the frequency of examiner errors, including administration and scoring errors. Results identified 511…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This article provides an introduction to the kind of computer software that is used to score student writing in some high stakes testing programs, and that is being promoted as a teaching and learning tool to schools. It sketches the state of play with machines for the scoring of writing, and describes how these machines work and what they do.…

This paper reports on an analysis of large-scale assessments of Grades 5-8 students' writing across 10 provinces and 2 territories in Canada. Theory, classroom practice, and the contributions and constraints of large-scale writing assessment are brought together with a focus on Grades 5-8 writing in order to provide both a broad view of…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

A variety of methods are used to assess secondary school seniors in Australia to determine college admission: locally-developed achievement tests in curricular subjects; external achievement tests; and general aptitude tests, such as the Australian Scholastic Aptitude Tests. Testing problems include aggregating and rescaling of scores. (GDC)

In the United States, tests are held to high standards of quality. In developing countries such as Malawi, psychometricians must deal with these same high standards as well as several additional pressures such as widespread cheating, test administration difficulties due to challenging landscapes and poor resources, difficulties in reliably scoring…

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…

The preliminary work of the Scottish "School-Based Assessment of Communicative Foreign-Language Skills in Secondary Classes 3 and 4" to train teachers to undertake increased testing responsibilities under recent educational reforms is explained. The models of communicative competence and performance being developed for use with classroom…

Annually in May and June, grade 3, 6, and 9 students in Alberta (Canada) take provincial achievement tests. This guide, in both English and French versions, explains the achievement tests. The tests are designed to indicate how well students meet the province's standards, to support teachers in planning instruction, and to inform the public about…

Accuracy in the scoring of writing is critical if standardized tasks are to be used in a national assessment scheme. Three approaches to establishing accuracy (i.e., consensus, consistency, and measurement) exist and commonly large-scale assessment programs of primary school writing demonstrate adjacent agreement consensus rates of between 80% and…

Annually in May and June, grade 3, 6, and 9 students in Alberta (Canada) take provincial achievement tests. This guide, in both English and French versions, explains the achievement tests. The tests are designed to indicate how well students meet the province's standards, to support teachers in planning instruction, and to inform the public about…

Annually in May and June, grade 3, 6, and 9 students in Alberta (Canada) take provincial achievement tests. This guide, in both English and French versions, explains the achievement tests. The tests are designed to indicate how well students meet the province's standards, to support teachers in planning instruction, and to inform the public about…