More than 20 years after the first round of the OECD's Programme for International Student Assessment (PISA), it has become one of the most important large-scale international assessments, at a global level and in particular in Europe. Thus, a growing number of scholars have examined or discussed its research design. Nonetheless, a key feature of…

Although encompassing a variety of research approaches, qualitative research in music education shares the assumption that reality is socially constructed; it takes this construction to be based on the specific perspective of the individual human; and it considers epistemology and ontology to be different fields of study. The posthuman theory of…

Over the past two decades, several methods have been developed to evaluate the societal impact of research. Compared to the practical development of the field, the conceptual development is relatively weak. This review article contributes to the latter by elucidating the theoretical aspects of the dominant methods for evaluating societal impact of…

Increased charter school demand creates a critical need for reliable information on outcomes. Stanford's Center for Research on Education Outcomes (CREDO) has a series of influential reports on charter schools using the virtual control record (VCR) method. However, the VCR method has been criticized and the validity of CREDO's findings challenged,…

Evaluative criteria define a "high quality" or "successful" evaluand and provide the basis for judgment of merit and worth, yet they are often assumed and implicit in the evaluation process. This article presents an empirically supported model that describes and integrates two aspects of criteria: domain and source. Domain…

Rating scale development in the field of language assessment is often considered in dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on performance data. Even though quite a few authors have argued that rating scale development is rarely so easily classifiable, this dyadic view has dominated language testing…

This paper examines the quality evaluations of the Greek Universities highlighting those which offer a full-fledged study program of primary education. There are eight principles-criteria according to which each university is evaluated. For each principle, scores may range from 1 (noncompliance with the principle) to 4 (fully compliance). I…

Purpose: In relation to the boom in China's SCI-indexed publications, this opinion piece examines this phenomenon and looks at future possible directions for the reform of China's research evaluation processes. Design/Approach/Methods: This opinion piece uses bibliographic data for the past decade (2010-2019) from the Science Citation Index…

Programme evaluation has developed tremendously over the past 50 years, with a proliferation of evaluation research, an increase in the institutionalization of evaluation, and growth in the professionalization of evaluation. However, existing research and developments are still largely in North America, Europe, Australia, and New Zealand, with…

One of the assessed research elements in the UK's Research Excellence Framework (REF) exercise in 2014 was the research environment. The quality of the research environment was assessed by expert peer reviewers who were given a set of quantitative factors to support their decision making. However, there is no systematic procedure to integrate this…

The synergies that result from synthesising conceptual models and findings from self-regulated learning and formative assessment research are launching a new era of scholarship. They drive new questions about how to help students to internalise complimentary self-regulatory and assessment knowledge, skills, and dispositions as well as how to…

Argument-based validation requires test developers and researchers to specify what is entailed in test interpretation and use. Doing so has been shown to yield advantages (Chapelle, Enright, & Jamieson, 2010), but it also requires an analysis of how the concerns of language testers can be conceptualized in the terms used to construct a…

This article questions whether social justice can live within the structural racism present in the field of evaluation. Structural racism refers to the totality of ways in which societies foster racial discrimination through mutually reinforcing systems of housing, education, employment, earnings, benefits, credit, media, health care, and criminal…

The UK's Research Excellence Framework (REF) is a system that is intended to evaluate the quality of the research produced by higher education institutes (HEIs) in the UK in three areas: quality of research outputs; impact of this research beyond academia; and research environment. For the next REF, the funding bodies have reviewed the importance…

With the introduction of a new initiative in a teaching and learning environment there is an ethical responsibility to consider whether the impact of the introduction has met its intended goals, and whether it has harmed those who are influenced by it. Technology and infrastructure developments have encouraged a continued growth in the development…