It is well known that research quality notions vary across research fields. Despite this, humanities quality notions are often portrayed as deviant or particularly hard to grasp. To some extent, this has a historical explanation, as notions from within the humanities have not been the standards used in the development of research evaluation tools.…

Debates about appropriate, fair and effective ways of assessing research and researchers have raged through the scientific community for decades, recently mostly concerned with discussing the merits and limitations of metric-based, quantitative assessments versus peer review-based, qualitative alternatives. Ample attention has been paid to formal…

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

This article explores underlying mechanisms triggering a change in conceptualization of innovation in the European Union (EU), the impact of this change on institutional demands upon European universities and implications for evaluation procedures. We mobilize the theoretical concept of critical junctures to explore significant periods that have…

Metrics-based reasoning patterns diffuse from core to periphery as peripheral and semi-peripheral countries adopt Western evaluation standards as formal categories or cultural scripts. While these scripts are applied across disciplines, each field maintains its own traditional criteria for scientific assessment. Consequently, scholars navigate…

This article provides a comprehensive analysis of the evaluation of the arts within performance-based research funding systems (PRFSs). Previous literature on PRFSs has overlooked the arts and focussed primarily on outputs in relation to the sciences and humanities. We develop a typology of how artistic outputs are evaluated within 10 countries'…

Impact assessment research has developed theory-based approaches to trace the societal impact of scientific research. Impact assessment typically starts from the perspective of a research investment, organization, or project. Research users, non-academic actors involved in knowledge production, translation, and application, are well represented in…

Participatory research can be promoted by scientific intermediary units, such as Science Shops. The overarching goal of these initiatives is thereby to foster a process of co-creation of the research questions to address societal needs that are relevant to scientific research and society at large. The InSPIRES project was a Horizon Europe…

The use of bibliometric indicators in research evaluation has a series of complex impacts on academic inquiry. These systems have gradually spread into a wide range of locations and disciplines, including the humanities. The aim of this study is to examine their effects as perceived by philosophy and ethics researchers in Spain, a country where…

In this article we attempt to reconstruct the tacit and implicit notions of quality in the humanities. This reconstruction is based on a series of semi-structured qualitative interviews with 33 humanities scholars. Applying Max Weber's theory of authority, we argue the quality notions have two different sources--external and internal. External…

Disciplines display field-specific ways of valuing research contributions, and these different 'styles of valuation' influence how academic careers are assessed and formed. Yet, differences in how research is evaluated are also prevalent between different levels of assessment: collegial and organizational. Consequently, we employ a multifaceted…

Whereas a growing number of studies evidence that research quality notions and evaluative practices are field- and context-specific, many focus on single evaluative practices or moments. This paper introduces the concept of "quality landscape" to capture dynamics of interrelated quality notions, evaluative moments and practices in a…

In many sectors and in many respects, interdisciplinarity has made progress in recent decades, but less so when it comes to evaluating interdisciplinary work. Challenges remain, especially regarding what counts as 'good' interdisciplinarity. While previous reviews describe broad trends contributing to these challenges, high-level observations are…

There has been a recent increase in attention toward the proper targets of evaluation in science funding policy. Specifically, some claim that we should 'fund people, not projects' to allow for increased autonomy for researchers. Critics argue that this movement unduly opens room for biases against several marginalized groups of scientists. In…

Over the past two decades, several methods have been developed to evaluate the societal impact of research. Compared to the practical development of the field, the conceptual development is relatively weak. This review article contributes to the latter by elucidating the theoretical aspects of the dominant methods for evaluating societal impact of…