It is well known that research quality notions vary across research fields. Despite this, humanities quality notions are often portrayed as deviant or particularly hard to grasp. To some extent, this has a historical explanation, as notions from within the humanities have not been the standards used in the development of research evaluation tools.…

Network meta-analysis (NMA) incorporates all available evidence into a general statistical framework for comparing multiple treatments. Standard NMAs make three major assumptions, namely homogeneity, similarity, and consistency, and violating these assumptions threatens an NMA's validity. In this article, we suggest a graphical approach to…

Background: It is important to capture a comprehensive language profile from speakers with aphasia. One way to do this is to evaluate spoken discourse, which is language beyond a single simple clause used for a specific purpose. While the historical trend in aphasiology has been to capture performance during isolated language tasks, such as…

This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

Evaluation of community-campus partnerships is a contested topic and, in many ways, is still at an early stage of development. With growing momentum behind community-university collaboration and increased pressure to document the positive impact of universities, there is a pressing need for research and innovation in this area. Many community…

Interdisciplinary working plays an important role in achieving impact outside academia. One barrier to interdisciplinary working is the lack of mechanisms to assess contributions from outside the primary discipline. Positioning our research in debates about knowledge translation, we analyse the ability of narrative cases to assess the…

Adaptive tutoring systems often model student knowledge in ways that break away from a "one size fits all" approach to learning. Nonetheless, the strengths of these systems can often be limited, as knowledge representations are not easily interpreted by teachers, which make these systems difficult to integrate into pedagogical practices.…

Few digital product development tools are used in industry and academia compared to their historic paper-based counterparts. This is surprising as many parts of the product development process have digitised such as communication and Computer-Aided Design. Therefore, a gap in knowledge was identified which informed the development of a novel…

School districts have an enormous number of resources available to them as they seek to grow student success and achievement. A review of the web-based educational technology resources a district is using, their effect, and the equitable distribution of these resources defines this problem of practice. This mixed-method approach addresses a…

Racially and ethnically diverse populations from minoritized backgrounds are often exposed to research methodologies that amplify structural racism and negate their sociocultural reality. Although cross-cultural validation of measures is considered a requisite step to multigroup comparisons, researchers apply measures validated and standardized in…

While adolescent foundational skills interventions can be critical levers for reading improvement, district leaders, teachers, and researchers must make complex decisions about how to evaluate their effectiveness in context. In this discussion article, we explore three issues and tensions we experienced during a 2-year research-practice…

This publication provides a guide for STEM Education Centers (SECs) and Centers for Teaching and Learning (CTLs) to carry out a self-assessment process focusing on their role(s) in undergraduate science, technology, engineering, mathematics (STEM) education. These resources were developed to assist centers in framing their contributions to…

Evaluation taking place within publicly funded research institutions (PRIs) has been practiced as a useful instrument to justify PRIs' public funding and to provide evidence for their internal decision-making. The role of evaluation in organizational governance is well-acknowledged as being important in PRIs' management practices. However, it has…

Start-up incubators are one of a number of micropolicy interventions used by states to support their technology entrepreneurs. Since 2000, the number of incubators in the United States has almost trebled while that in Europe has more than doubled. This article outlines the challenges involved in attempting to evaluate the contribution of the…

In educational contexts where many domains subject to improvement are interdependent and causal evidence is frequently lacking it is difficult, if not impossible, for policymakers and educational practitioners to decide which domain should be invested in. This paper proposes a new method that uses Conditional Mean Independent Correlations (CMIC)…