Merit-based procedures should be constantly reevaluated according to the circumstances to remain both valid and fair--two interrelated concepts. Inducing reevaluation, however, is difficult. These procedures are controlled by legitimate authorities, are rule and contract-bound, and can become quickly entrenched. This resistance to change calls for…

Celpe-Bras, is the exam for the certification of proficiency in Portuguese as a foreign language. It, is the only Portuguese proficiency test recognized by the Brazilian government (Ministério da Educação, 2013). Given the recent growth of interest and also its unique design as a large-scale proficiency test, this article provides a general…

Recently, there has been a change from traditional language testing approaches, with a focus on psychometric properties towards critical language testing (CLT) with its social practice nature. CLT assumes tests not as neutral devices but as instruments of power and control which are related to authorities' policy agendas to shape individuals' and…

We investigate the extent to which language versions (English, French and Arabic) of the same science test are comparable in terms of item difficulty and demands. We argue that language is an inextricable part of the scientific literacy construct, be it intended or not by the examiner. This argument has considerable implications on methodologies…

Most implementations of the Mantel-Haenszel differential item functioning procedure delete records with missing responses or replace missing responses with scores of 0. These treatments of missing data make strong assumptions about the causes of the missing data. Such assumptions may be particularly problematic when groups differ in their patterns…

Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

Unsupervised summative assessment has become a feature of the educational landscape in various educational jurisdictions around the world, including the state of Queensland in Australia. However, I suggest it is an invalid and unnecessary practice that can impact negatively on the affect of students, call for a reconsideration of its use, and…

The author discusses his observations from administering such tests as the Denver Developmental Screening Test (DDST) to young disabled children in Costa Rica. Cultural influences and nuances of translations are seen to affect performance. Factors involved in remediation programing are also noted. A final consideration is the "barrio…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

In June 1995, the Scottish Council for Research in Education began a 5-month study of the Standard Entrance Examination (SET) to the police in Scotland. The first phase was an analysis of existing recruitment and selection statistics from the eight Scottish police forces. Phase Two was a study of two police forces using a case study methodology.…

The validity of the Canadian Tests of Basic Skills is examined from the perspective that several of its subtests are highly speeded. Results show that there is very little relationship between the number of items attempted and the number correct and suggest that guessing is involved when more items are attempted. (Author/JAZ)

Twenty-four French-speaking students in a northeast Ontario (Canada) elementary school were administered an intelligence test in grades three, five, and eight. Significant differences among the three testings raise concerns about the practice of intelligence testing among cultural minority populations. Such tests should not be administered to all…

A method is proposed for the detection of item bias with respect to observed or unobserved subgroups. The method uses quasi-loglinear models for the incomplete subgroup x test score x item 1 x ... x item k contingency table. If the subgroup membership is unknown, the models are the incomplete-latent-class models of S. J. Haberman (1979). The…

The use of loglinear latent class models to detect item bias was studied. Purposes of the study were to: (1) develop procedures for use in assessing item bias when the grouping variable with respect to which bias occurs is not observed; (2) develop bias detection procedures that relate to a conceptually different assessed trait--a categorical…

The issue of unfairness arises in high-stakes public examinations when students choose questions from alternatives that are offered and marks on the alternatives turn out to be discrepant. This paper addresses and defines unfairness and discrepancy in the context of alternative questions in Physics Tertiary Entrance Examinations (TEE) in Western…