On the back of Research Excellence Framework (REF) 2021, this collection brings together a wide range of authors to consider what has worked well in evaluation of UK research, what could have worked better and where the UK's higher education system should go from here. Chapters in the volume include: (1) The REF: A hydra-headed beast or an…

Over the last few decades, there has been an increase in the number of large federally funded transdisciplinary programs and initiatives. Scholars have identified a need to develop frameworks, methodologies, and tools to evaluate the effectiveness of these large collaborative initiatives, providing precise ways to understand and assess the…

The aim of this research was to conduct a review of studies using four-tier tests to detect misconceptions in physics education. Fifty-eight studies whose main purpose was to develop a four-tier misconception test and eleven studies whose purpose was to determine learners' misconceptions using a four-tier diagnostic test without test development…

The term "meta-evaluation"--referring to the "evaluation of evaluations"--has been in the evaluation lexicon for a half-century. Despite this longevity, research on meta-evaluation is sparse and even more so for internal formative types of meta-evaluation. This exploratory study builds on our understanding of meta-evaluative…

Rating scale development in the field of language assessment is often considered in dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on performance data. Even though quite a few authors have argued that rating scale development is rarely so easily classifiable, this dyadic view has dominated language testing…

Monte Carlo methods are an accepted methodology in regards to generation critical values for a Maximum test. The same methods are also applicable to the evaluation of the robustness of the new created test. A table of critical values was created, and the robustness of the new maximum test was evaluated for five different distributions. Robustness…

The State NAEP program only reports the mean achievement estimate of a subgroup within a given state if it samples at least 62 students who identify with the subgroup. Since some subgroups of students constitute small proportions of certain states' general student populations, these low-incidence groups of students are seldom sufficiently sampled…

This paper examines the quality evaluations of the Greek Universities highlighting those which offer a full-fledged study program of primary education. There are eight principles-criteria according to which each university is evaluated. For each principle, scores may range from 1 (noncompliance with the principle) to 4 (fully compliance). I…

The world has experienced rapid changes, leading to pressing issues such as environmental degradation, social inequality, and resource depletion. As a transdisciplinary field, evaluation has emerged as a crucial tool in addressing these challenges and promoting systemic change. However, concerns have been raised regarding the field's capacity to…

This study aimed to demonstrate how one university worked to overcome some of the measurement problems associated with legacy student rating instruments through the creation and investigation of a new student rating instrument based on the most current scholarship on teaching and learning. Measurement problems with legacy instruments include…

One of the diagnostic tests which is very valuable and used in education frequently is two-tier test. Two-tier tests are used for different purposes such as determining misconceptions, determining the comprehension level of students and etc.. Due to the wide and effective uses of two-tier tests, there are different studies in which two-tier tests…

Purpose: In relation to the boom in China's SCI-indexed publications, this opinion piece examines this phenomenon and looks at future possible directions for the reform of China's research evaluation processes. Design/Approach/Methods: This opinion piece uses bibliographic data for the past decade (2010-2019) from the Science Citation Index…

The notions of indigenous knowledge and cultural philosophies are becoming ubiquitous in many social inquiries, and evaluation is no exception. Nonetheless, the pursuit to embed relevant indigenous philosophies in contemporary evaluation has yet to succeed. In this article, we discuss indigenous relational philosophies, approaches, and practices…

Programme evaluation has developed tremendously over the past 50 years, with a proliferation of evaluation research, an increase in the institutionalization of evaluation, and growth in the professionalization of evaluation. However, existing research and developments are still largely in North America, Europe, Australia, and New Zealand, with…

The current range and volume of research evaluation-related literature is extensive and incorporates scholarly and policy/practice-related perspectives. This reflects academic and practical interest over many decades and trails the changing funding and reputational modalities for universities, namely increased selectivity applied to institutional…