Canada does not have a national system wide assessment of the socioeconomic impacts of academic research. We do not have a Research Excellence Framework such as in the United Kingdom. Yet Canadian researchers, funders and institutions are interested in research impact, particularly the methods and processes for generating impacts to complement…

This paper describes the development of a bibliometric strength, potential and risk analysis tool, and its applications for research strategy and evaluation. We focus specifically on the motivation, organizational strategic needs, the development and evaluation of the tool. Furthermore, we highlight the co-creation process of the tool and discuss…

The corona pandemic has had a significant impact on society and posed multiple challenges for national research systems to provide guidance to policy makers in the face of the rapidly changing global crisis situation. However, existing methods generally do not allow for an early and reliable assessment of how national research systems have reacted…

Diverse efforts are underway to reform the journal peer review system. Combined with growing interest in Open Science practices, Open Peer Review (OPR) has become of central concern to the scholarly community. However, what OPR is understood to encompass and how effective some of its elements are in meeting the expectations of diverse communities,…

The monitoring and evaluation of R&I policies relies on quantitative and qualitative methods with important methodological shortcomings. Quantitative assessments rely on standardized indicators that do not capture context-specific challenges, while qualitative approaches lack comparability. Both approaches are complementary but not always…

This article offers a framework for the study of research governance effects on scientific fields framed by notions of research quality and the epistemic, organizational, and career choices they entail. The framework interprets the contested idea of 'quality' as an interplay involving notion origins, quality attributes, and contextual sites. We…

Participatory research can be promoted by scientific intermediary units, such as Science Shops. The overarching goal of these initiatives is thereby to foster a process of co-creation of the research questions to address societal needs that are relevant to scientific research and society at large. The InSPIRES project was a Horizon Europe…

This article reports on a study that followed up on an initial interdisciplinary project and focused specifically on the experiences of researchers involved in practice-based interdisciplinary research. We share an approach to research evaluation that focuses on the experiences of those conducting the research rather than the outputs. The study…

Over the past two decades, several methods have been developed to evaluate the societal impact of research. Compared to the practical development of the field, the conceptual development is relatively weak. This review article contributes to the latter by elucidating the theoretical aspects of the dominant methods for evaluating societal impact of…

The evaluation of the social impact of research is a critical concern for both the scientific and social communities. This study aims to describe the social impact of scientific research outcomes in the field of Social Sciences in Cuba. Five dimensions of analysis and 16 alternative indicators were utilized, employing altmetric tools and data…

This study examines the relationship between sustainability performance and knowledge, as well as between innovation transfer and co-production. It moves away from evaluating processes to exploring impact by investigating how explicit and tacit knowledge archetypes are associated with sustainability performance in the agri-food sector. Applying…

Policy-makers, research managers, and donors are interested in knowing the outputs, outcomes, and impacts of investment in agricultural research. Several institutions are engaged in rice research and impact assessment of rice research requires area coverage information for rice varieties. The area coverage information for individual varieties is…

This study examines a basic assumption of peer review, namely, the idea that there is a consensus on evaluation criteria among peers, which is a necessary condition for the reliability of peer judgements. Empirical evidence indicating that there is no consensus or more than one consensus would offer an explanation for the "disagreement…

Problems framed as societal challenges have provided fresh impetus for transdisciplinary research. In response, funders have started programmes aimed at increasing transdisciplinary research capacity. However, current programme evaluations do not adequately measure the skills and characteristics of individuals and collectives doing this research.…

A positive working environment and culture are essential for researchers as these enable them to conduct valuable, high-quality research. Yet, university staff frequently report their research culture as less than ideal. To understand researchers' experiences of research culture to inform tangible change, several surveys have been conducted by…