Variation in examiner stringency is an ongoing problem in many performance settings such as in OSCEs, and usually is conceptualised and measured based on scores/grades examiners award. Under borderline regression, the standard within a station is set using checklist/domain scores and global grades acting in combination. This complexity requires a…

Test-retest reliability assessments rarely investigate whether reliability itself is stable or change in reliability affects findings from substantive models. Research across the social sciences often recognizes that measurement error could influence results, yet it rarely applies established error correction methods. Focusing on gender wage…

Non-formal adult education (NFE) provides adults of all ages with the opportunity to acquire skills, knowledge, and expertise. However, there is currently a lack of validated instruments that measure the factors of NFE non-participation in European countries, particularly their barriers. One exception is the Non-participation in Non-formal…

The United Kingdom's (UK's) Research Excellence Framework of 2014 was an expensive high stakes evaluation which had a range of impacts on higher education institutions across the country. One component was an assessment of the quality of research outputs where a major feature was a series of panels organised to read and rate the outputs of their…

This case study relates to distance learning students on open access courses. It demonstrates the use of predictive analytics to generate a model of the probabilities of success and retention at different points, or milestones, in a student journey. A core set of explanatory variables has been established and their varying relative importance at…

Evidence from recent research suggests that in the UK the public perception of errors in national examinations is that they are simply mistakes; events that are preventable. This perception predominates over the more sophisticated technical view that errors arise from many sources and create an inevitable variability in assessment outcomes. The…

There is accumulating evidence that individual differences in stress reactivity contribute to the risk for stress-related disease. However, the assessment of stress reactivity remains challenging, and there is a relative lack of questionnaires reliably assessing this construct. We here present the Perceived Stress Reactivity Scale (PSRS), a…

There is considerable variation between male and female Bachelor degree performance at Oxford and Cambridge (Oxbridge) where male students attain more First and Third Class degrees and female students attain more Second Class degrees. Various hypotheses have been put forward to explain this phenomenon including the possibility that the distinctive…

The aim of this study is to assess the effective measurement range of Ryff's Psychological Well-being scales (PWB). It applies normal ogive item response theory (IRT) methodology using factor analysis procedures for ordinal data based on a limited information estimation approach. The data come from a sample of 1,179 women participating in a…

This paper addresses a key methodological challenge in the modeling of individual poverty dynamics--the influence of measurement error. Taking the US and Britain as case studies and building on recent research that uses latent Markov models to reduce bias, we examine how measurement error can affect a range of important poverty estimates. Our data…

This paper uses a new survey of graduates from one large civil university in the UK to examine the determinants of over-education and its subsequent impact on labour market earnings. Multiple measurements of over-education were collected to assess the effect of measurement error on the estimated pay penalty associated with over-education. Panel…

Assessment agencies are increasingly facing pressure on two fronts; first, to increase transparency and openness and second, to improve public confidence. Yet, in relation to one of the central concepts of educational measurement--inherent error--many believe that increased public understanding is incompatible with public confidence: a general…

This study estimates the proportion of academic and public library acquisitions in the United Kingdom for which a UK MARC record is available at the time of cataloging. A beta-binomial model is used to attribute standard errors to each estimate and to compare differences between the two types of libraries. (Author/LRW)

This article cautions against complacency in "subjective" assessment, arguing that even tests designed to reflect the development of learner-centered, interactive and communicative approaches to teaching English may have cultural bias built into their assessment criteria. The reply article singles out as an unresolved issue whether or…

This paper presents ongoing research at the University of Hertfordshire on the use of computer-adaptive tests (CATs) in Higher Education. A software prototype based on Item Response Theory has been developed and is described here. This application was designed to estimate the level of proficiency in English for those students whose first language…