This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

Evaluating the impact of Academic Literacies teaching (Lea and Street [1998. "Student Writing in Higher Education: An Academic Literacies Approach." "Studies in Higher Education" 23 (2): 157-72. doi:10.1080/03075079812331380364]) is difficult, as it involves gauging whether writers: (1) gain better understanding of what…

Institutional ethics review procedures aim -- in principle -- to minimise harm and evaluate risks, providing an important space to consider the safety of participants and researchers. However, literature has questioned the effectiveness of the process, particularly for reviewing 'risky' topics in a risk-averse environment. This article reports the…

In Comparative Judgement (CJ) exercises, examiners are asked to look at a selection of candidate scripts (with marks removed) and order them in terms of which they believe display the best quality. By including scripts from different examination sessions, the results of these exercises can be used to help with maintaining standards. Results from…

This guidance is intended for the planning stage of trials -- in particular, trials for which the primary outcome measure being considered is attainment at GCSE (and in particular, GCSE English Language and Mathematics). However, it is generalisable to any other graded qualification or assessment used as an outcome measure, i.e. A-levels. It is…

The purpose of this study was to investigate Access Arrangements (AA) which allow students with specific learning difficulties (SpLDs), disabilities or medical needs to access assessments by making "reasonable" adjustments, as established by the Equality Act 2010. A review of the literature revealed some problematic issues relating to…

This paper aims to survey the current landscape of education policy evaluation across OECD countries and economies by examining recent trends and contextual factors that can promote more robust education policy evaluation, as well as identifying key challenges. It takes a view of policy evaluation as an activity that takes place throughout the…

Undergraduate clinical assessors make expert, multifaceted judgements of consultation skills in concert with medical school OSCE grading rubrics. Assessors are not cognitive machines: their judgements are made in the light of prior experience and social interactions with students. It is important to understand assessors' working conceptualisations…

This study examines the early-stage progress assessment for doctoral candidates at a British university through the perceptions of academic staff who acted as assessors. It was conducted in response to staff concerns about changes to the process that shortened the timescale for candidates to prepare and present their research for peer review. As…

This study investigates the perceived benefits to academics who assess HEA Fellowship applications in one institution. Results show that the assessors experience similar benefits from engaging with the continuing professional development (CPD) scheme as those reported by applicants. The data also indicate that the scheme nurtures a…

Creativity is an inherent element of contemporary dance and is frequently cited as a key pedagogical objective of higher education dance training. Nevertheless, there is little writing about the means by which dance teachers understand, recognize, and subsequently assess creativity at the higher education level. We undertook semistructured…

Pressure on evaluators has been investigated recently by surveys in the USA, the UK, Germany, and Switzerland. This study compares the results of those studies regarding pressure on evaluators in different countries. The findings suggest that independence of evaluations does not exist for many respondents. Moreover, the person who commissioned the…

Efforts to monitor and improve responsive caregiving for young children, because of its importance for child development, are part of the United Nations Sustainable Development Goals. Two brief observational measures of responsive caregiving have been developed and validated (Responsive Interactions for Learning-parent [RIFL-P] and educator…

In this paper we outline the use of a concept mapping narrative method to elicit the complex and interconnected conceptualisations of specialized knowledge (assessment literacy) for a specific cohort of participants (teacher-examiners). In particular, we are interested in exploring how relational concept mapping and narrative interviews can be…

Autistic adults who have a history of committing crimes present a major problem for providers of services in terms of legal disposal options and possible interventions, and greater understanding of this group and their associated needs is required. For this reason, we aimed to investigate the face validity of a proposed sub-typology of autistic…