There is a lively discussion on how to evaluate competence-based higher education in both evaluation and competence research. The instruments used are often limited to course evaluation or specific competences, taking a rather narrow perspective. Furthermore, the instruments often comprise predetermined competences that cannot be adapted to higher…

Evaluation of professional learning illuminates the interactions that occur in the implementation of planned learning experiences and the necessary supports designed to improve professional practice and its effects on students. It investigates how a set of actions designed to achieve defined short- and long-term outcomes occur over time and how…

Construct irrelevance (CI) and construct underrepresentation (CU) are 2 major threats to validity, yet they are rarely discussed within the counseling literature. This article provides information about the relevance of these threats to internal validity. An illustrative case example will be provided to assist counselors in understanding these…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

What is different about the conduct of evaluations in conflict zones compared to nonconflict zones--and how do these differences affect (if at all) the ethical calculations and behavior of evaluators? When are ethical issues too risky, or too uncertain, for evaluators to accept--or to continue--an evaluation? These are the core questions guiding…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

Since its inception in 1990, the Language Testing Research Centre (LTRC) at the University of Melbourne has earned an international reputation for its work in the areas of language assessment and testing as well as program evaluation. The mission of the centre is: (1) to carry out and promote research and development in language testing; (2) to…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

We examined the extent to which mathematics program evaluations that have been conducted according to methodologically rigorous standards have attended to the theories underlying the programs being evaluated. Our analysis focused on the 37 reports of K-12 mathematics program evaluations in the last two decades that have met standards for inclusion…

As dynamic assessment (DA) continues to come to prominence as a procedure that endeavors to ameliorate learner performance and further development through mediators' assistance with the intent of discerning learning potential, a plethora of research has delved into the applicability of DA in second/foreign language education. This article employed…

Work based assessment (WBA) is a common but contentious practice increasingly used to grade university students on professional degrees. A key issue in WBA is the potentially low assessment literacy of the assessors, which can lead to a host of unintended results, including grade inflation. We identified grade inflation in the WBA of the clinical…

Ongoing colonial power has long been ascribed to government bureaucracy and institutions of higher learning. By consequence, Indigenous communities today are still experiencing challenges regarding the function, foundation and fabric of research that impacts Indigenous peoples, including in the arena of social work education. Writing as an…

Research on evaluation theories, methods, and practices has increased considerably in the past decade. Even so, little is known about whether published findings from research on evaluation are read by evaluators and whether such findings influence evaluators' thinking about evaluation or their evaluation practice. To address these questions, and…

Drawing on Foucault's elaboration of neoliberalism as a positive form of state power, the ascendancy of neoliberalism in higher education in Britain is examined in terms of the displacement of public good models of governance, and their replacement with individualised incentives and performance targets, heralding new and more stringent conceptions…

With the push for evidence-informed policy and practice, schools and policy makers are now increasingly encouraged and supported to use and enagage with research evidence. This means that consumers of research will now need to be discerning in judging the quality of research evidence that will inform their decisions. This paper evaluates the…