It is well known that research quality notions vary across research fields. Despite this, humanities quality notions are often portrayed as deviant or particularly hard to grasp. To some extent, this has a historical explanation, as notions from within the humanities have not been the standards used in the development of research evaluation tools.…

Network meta-analysis (NMA) incorporates all available evidence into a general statistical framework for comparing multiple treatments. Standard NMAs make three major assumptions, namely homogeneity, similarity, and consistency, and violating these assumptions threatens an NMA's validity. In this article, we suggest a graphical approach to…

Background: It is important to capture a comprehensive language profile from speakers with aphasia. One way to do this is to evaluate spoken discourse, which is language beyond a single simple clause used for a specific purpose. While the historical trend in aphasiology has been to capture performance during isolated language tasks, such as…

Evaluation of research performance has significantly increased in importance, particularly in many emerging higher education systems. In Malaysia, the Malaysian Research Assessment (MyRA) was developed to evaluate the research performance of universities and Research Centres of Excellence (RCoEs). This paper reports on a participatory action…

This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

Evaluation of community-campus partnerships is a contested topic and, in many ways, is still at an early stage of development. With growing momentum behind community-university collaboration and increased pressure to document the positive impact of universities, there is a pressing need for research and innovation in this area. Many community…

Innovation agencies, that is organizations with the primary focus of funding applied research and technological development, evaluate project proposals to select the most promising proposals for funding. At the moment, there is only little verified knowledge available on project evaluation and selection processes of innovation agencies. We want to…

With the growing complexity of societal and scientific problems, research centers have emerged to facilitate the conduct of research beyond disciplinary and institutional boundaries. While they have become firmly established in the global university landscape, research centers raise some critical questions for research evaluation. Existing…

Interdisciplinary working plays an important role in achieving impact outside academia. One barrier to interdisciplinary working is the lack of mechanisms to assess contributions from outside the primary discipline. Positioning our research in debates about knowledge translation, we analyse the ability of narrative cases to assess the…

Adaptive tutoring systems often model student knowledge in ways that break away from a "one size fits all" approach to learning. Nonetheless, the strengths of these systems can often be limited, as knowledge representations are not easily interpreted by teachers, which make these systems difficult to integrate into pedagogical practices.…

Few digital product development tools are used in industry and academia compared to their historic paper-based counterparts. This is surprising as many parts of the product development process have digitised such as communication and Computer-Aided Design. Therefore, a gap in knowledge was identified which informed the development of a novel…

School districts have an enormous number of resources available to them as they seek to grow student success and achievement. A review of the web-based educational technology resources a district is using, their effect, and the equitable distribution of these resources defines this problem of practice. This mixed-method approach addresses a…

Racially and ethnically diverse populations from minoritized backgrounds are often exposed to research methodologies that amplify structural racism and negate their sociocultural reality. Although cross-cultural validation of measures is considered a requisite step to multigroup comparisons, researchers apply measures validated and standardized in…

While adolescent foundational skills interventions can be critical levers for reading improvement, district leaders, teachers, and researchers must make complex decisions about how to evaluate their effectiveness in context. In this discussion article, we explore three issues and tensions we experienced during a 2-year research-practice…

This publication provides a guide for STEM Education Centers (SECs) and Centers for Teaching and Learning (CTLs) to carry out a self-assessment process focusing on their role(s) in undergraduate science, technology, engineering, mathematics (STEM) education. These resources were developed to assist centers in framing their contributions to…