Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

As part of its regulatory roles, the Australian Government Tertiary Education Quality and Standards Agency (TEQSA) is required to assess evidence of 'scholarship' that is put forward by providers, whether evidence of scholarship by individuals, such as teaching staff within the provider, or for the provider as a whole. TEQSA is seeking to review…

This article discusses the internationalization capacity building project at the Karaganda Technical University ('KTU') in Kazakhstan. The project, entitled "Capacity building for the internationalization of a technical university by means of digital learning technologies," was supported by the fund "Scientific foundations…

In the context of the "Higher Education Standards Framework (Threshold Standards) 2015" (HES Framework), 'scholarship' means those activities concerned with gaining new or improved understanding, appreciation and insights into a field of knowledge, and engaging with and keeping up to date with advances in the field. This includes…

A typology of budget-driven program reviews is categorized by two variables: the locus of responsibility and the timing of the review. When a budget-driven program review is first implemented during a crisis, the range of financial and administrative options are high, yet buy-in and match to mission are low. When a budget-driven program review is…

Most states have developed or revised school accountability systems in response to the Every Student Succeeds Act (ESSA). While these systems include multiple indicators, to many stakeholders the outcome of central interest is the overall rating or classification produced for each school. These ratings are often used to identify schools that merit…

The act of valuing in an evaluation may be perceived in different ways. We consider the multiple theoretic perspectives that govern an evaluator's behavior and present a typology of evaluator valuing roles. Within this typology we describe three ways in which value judgments are typically reached--by stakeholders alone, stakeholders and evaluators…

There is growing interest in the concept of "mechanism" across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of…

There are many different models or approaches to doing program evaluation. Fitzpatrick, Sanders, and Worthen classify them into five general approaches: (a) objectives oriented, (b) management oriented, (c) consumer oriented, (d) expertise oriented, and (e) participant oriented. Within each of these general categories, of course, reside many…

This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

Outcomes-based program evaluation is a systematic approach to identifying outcome indicators and measuring results against those indicators. One dimension of program evaluation is assessing the level of learner acquisition to determine if learning objectives were achieved as intended. The purpose of the proposed model is to use Bloom's Taxonomy to…

School choice is one of the most frequent recommendations for education reform in the United States today. Unfortunately, the debates are hindered by the lack of a common taxonomy or framework for discussing and evaluating the wide variety of school choice programs available in the United States. Furthermore, there is little information on the…

The Institute of Education Sciences (IES) and the What Works Clearinghouse (WWC) have identified topic areas that present a wide range of this nation's most pressing issues in education (e.g., middle school math, beginning reading, and character education). Within each selected topic area, the WWC collects studies of interventions (i.e., programs,…

Presents a conceptual framework for putting program theory into operation. The framework incorporates variables that reflect theoretical concepts and implementation issues addressed in program evaluation. It organizes variables into input, process, and output categories. Discusses implications for program evaluation. (SLD)