Since its inception in 1993, Ofsted has been charged with maintaining standards in schools in England. But how has this worked out? A former inspector gives his account of the journey from the inside. His point of view can be summarised from a conversation he had with a senior Ofsted inspector on his first Inspection: 'You're still on their side.…

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

The European Research Council (ERC) receives many high-quality applications, but funds only a few. We analyze how members of ERC review panels assess applications in the first, highly competitive step of evaluations for ERC Starting and Consolidator Grants. Drawing on interviews with ERC panel members in different fields, we show that they adopt a…

This guidance is intended for the planning stage of trials -- in particular, trials for which the primary outcome measure being considered is attainment at GCSE (and in particular, GCSE English Language and Mathematics). However, it is generalisable to any other graded qualification or assessment used as an outcome measure, i.e. A-levels. It is…

In this paper we outline the use of a concept mapping narrative method to elicit the complex and interconnected conceptualisations of specialized knowledge (assessment literacy) for a specific cohort of participants (teacher-examiners). In particular, we are interested in exploring how relational concept mapping and narrative interviews can be…

In the last quarter of the nineteenth century, the limitations imposed by the restrictive payment-by-results curriculum were gradually relaxed, and many members of Her Majesty's Inspectorate were able to welcome the opportunity to focus their efforts upon supporting schools, teachers, and even individual pupils. This article looks at the work of…

Kazakhstan has made tremendous progress in ensuring universal access to primary and lower-secondary education. Nevertheless, results international surveys reveal that almost two-thirds of students from Kazakhstan complete schooling without mastering the basic skills needed to be successful, and that student achievement is increasingly inequitable.…

This chapter focuses on the governing work of Swedish school inspectors with regards to the role and function of knowledge. As professionals, inspectors are situated as relays and brokers of policy standing in contact with both the political arena and practice arenas. School inspectors use and produce knowledge and they rely on, search for,…

In 2020, because of the COVID-19 pandemic the higher education sector, in the United Kingdom and internationally, transitioned to online assessment, at a speed and scale which might have been unimaginable under normal circumstances. The priority in the sector was to ensure that fundamental principles of assessment, including integrity, were…

The Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans (TCPS) was first developed to establish a standard of practice in research ethics by the three federal agencies responsible for funding institutional research in Canada: Canadian Institutes of Health Research (CIHR), Natural Sciences and Engineering Research Council…

Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

This paper addresses the place of the use of international "experts" in assuring the quality of Teacher Education programmes within Higher Education, in relation to the global agenda of improving standards. The experiences of one such "expert" are discussed and recommendations made as to the type of person suited to the role.…

Successive UK government policies have strengthened the phonics element of the National Curriculum for English in England. The policies have included inviting publishers to submit completed self-assessments of their systematic phonics programmes. The self-assessment criteria focus on what is deemed to be 'high-quality provision', as defined in the…

Since September 2015 the Office for Standards in Education (Ofsted) has introduced major changes to its inspection procedures and expectations. These are embodied in its handbook for school inspection. Ofsted claims more than it can deliver; in particular it makes impossible demands on its inspectors--in terms of applying both evaluation criteria…