This paper summarises our research into the relationship between pupil assessment at age 14 (Key Stage 3) and participation in age 16+ education. We question whether a systematic gap between teacher-based assessment and externally marked tests indicates assessment bias or uncertainty, either in testing procedures or through teachers' perceptions…

Surprising version-dependent differences are noted in student performance on certain questions in a standardized general chemistry exam. The exam in question has two versions, on which both questions and answers are ordered differently. For the questions suspected of answer-order bias, the performance is better in ten of twelve cases when students…

The recent decision by the Department of Education and Science in the Republic of Ireland to introduce the mandatory testing of children in Irish primary schools provides the broad context for this paper. This decision has particular implications for schools designated as disadvantaged. The main focus of this study is on identifying the strategies…

This article presents a response to the paper by Li, D'ngiulli and Kendall (2007). The authors address two key aspects of this paper. The first concerns a number of errors and misconceptions in the paper that the authors think are important to clarify and correct. The second issue relates to the significant amount of research and effort that has…

This paper proposes a method of transforming item p-values (the proportion answering a test item correctly) to what are termed "delta" values. First used by Conrad in l948, deltas are routine statistics computed in all analyses at Educational Testing Service. Using this approach one would conclude no test bias if differences in resulting deltas…

Although much has been said about ergonomics in interface and in computer tools and interface design, very few articles in major journals have addressed this topic in relation to language testing. This article describes an experiment carried out at the Polytechnic University of Valencia, Spain, in which 27 Media and Communication students provided…

Wright and Stone had proposed three features to assess the quality of the distribution of the items difficulties in a test, on the so called "most probable response map": line, stack and gap. Once a line is accepted as a design model for a test, gaps and stacks are practically eliminated, producing an evidence of the "scale…

PEPNet's "Perspectives" is the collaborative newsletter of the four PEPNet regional centers. This newsletter combines each centers individual strengths into a single resource that can be used on a national level. The issue focuses on the following topics: (1) Web Tool Locates Needed Resources; (2) Family Center on Technology and Disability (Ana…

This paper examines whether educational production in secondary school involves joint production among teachers across subjects. In doing so, it also provides insights into the reliability of value-added modeling. Teacher value-added to reading test scores is estimated for four different teacher types: English, math, science and social-studies.…

Large data sets from a state reading assessment for third and fifth graders were analyzed to examine differential item functioning (DIF), differential distractor functioning (DDF), and differential omission frequency (DOF) between students with particular categories of disabilities (speech/language impairments, learning disabilities, and emotional…

This article provides the background and context to the important issue of assessment and equity in relation to Indigenous students in Australia. Questions about the validity and fairness of assessment are raised and ways forward are suggested by attending to assessment questions in relation to equity and culture-fair assessment. Patterns of…

Confirmatory factor analyses for ordered-categorical measures probed for differential item functioning on a standardized measure of alcohol dependence across Hispanics (n = 834) and non-Hispanic Caucasians (n = 14,001) in a nationally representative survey of alcohol use in the United States conducted in 1992. Analyses investigated whether 30…

This paper provides an overview of the issue of student anonymity in the summative assessment of student work in higher education. It considers both theoretical literature pertaining to bias in the evaluation of the work of others and the limited empirical work undertaken on this issue in higher education. It then describes the experience of three…

This study investigates the effect of reporting the unadjusted raw scores in a high-stakes language exam when raters differ significantly in severity and self-selected questions differ significantly in difficulty. More sophisticated models, introducing meaningful facets and parameters, are successively used to investigate the characteristics of…

The TOEFL iBT[TM] has increased the length of the reading passages in the reading section compared to the passages on the TOEFL[R] computer-based test (CBT) to better approximate academic reading in North American universities, resulting in a reduced number of passages in the reading test. A concern arising from this change is whether the decrease…