Study Skills in any guise are integral to Higher Education worldwide, existing to help student success. Some argue generic or bolt-on Study Skills do not help with success, others that embedded Study Skills do, but no-one advocates actually evaluating Study Skills in a context of success defined as helping with student educational gain and…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

More evaluators have anchored their work in equity-focused, culturally responsive, and social justice ideals. Although we have a sense of approaches that guide evaluators as to how they should attend to culture, diversity, equity, and inclusion (DEI), we have not yet established an empirical understanding of how evaluators measure DEI. In this…

This guidance updates Training and Employment Guidance Letter (TEGL) 10-16, Change 2, published September 15, 2022, and developed jointly by the U.S. Departments of Labor (DOL) and Education (ED) (the Departments). Within ED, the Office of Career, Technical, and Adult Education (OCTAE) will update Program Memorandum (PM) 17-2, and the…

In October of 2019, I presented at the IUPUI Assessment Institute in Indianapolis on the topic of academic program review. While almost every campus conducts program reviews, the definition, purpose, structure, and integration of assessment in program reviews is not universally understood, accepted, or implemented. This paper summarizes essential…

The article revisits the literature on educational partnerships in an attempt to re-frame and update conceptual frameworks to be used by school and district leaders for partnership development and evaluation. It also synthesizes and analyzes empirical literature specific to developing educational partnerships or analyzing the strengths that…

The term "entrepreneurial mindset" is often included in the program objectives of engineering entrepreneurship programs. However, the definition of the term has been argued and debated by many in the community and in the literature, leading to challenges with how to best design assessment of engineering entrepreneurship programs. The…

Background: Domestic violence abuse (DVA) has been identified by the UK Government as a priority to address. Whilst there is a growing body of research into perpetrators of DVA from the mainstream population, there is scant research into perpetrators of DVA who have an intellectual disability. This lack of an evidence base suggests there may be a…

In this paper we investigate the effect of difference in outcome definitions on the result of impact evaluations. The Swedish workplace practice programme is evaluated, using matching methods. The key findings are that changing how the outcome is defined has a considerable influence on the results of the impact assessment. From the results of this…

Wellbeing is an emerging priority that poses a "wicked" problem. Current directives from policy makers are that schools address student wellbeing. However, the lack of a clear definition, simple solution or process for ensuring wellbeing creates a difficult task for schools. This article seeks to add to the current understanding of…

The terms "outcome" and "impact" are ubiquitous in evaluation discourse. However, there are many competing definitions that lack clarity and consistency and sometimes represent fundamentally different meanings. This leads to profound confusion, undermines efforts to improve learning and accountability, and represents a…

Treatment integrity (TI) refers to the degree to which an intervention is implemented as intended. We analyzed 67 youth intervention studies published in "Professional School Counseling" from 1997 to 2018. More than half (55%) of the interventions were operationally defined and 16.4% of the studies monitored TI, but only 6%…

A customized guide about liberatory design thinking processes that have been tested within college settings to support changes that enhance equity in policies and practices within institutions. This research is based on case studies of several institutions, including focus group interviews with the campus design teams and an analysis of artifacts.…

Purpose: This study presents a novel methodology/process for assessing inclusion of theoretically-based implementation factors within available adoption-ready health promotion programs. Methods: Classroom-based physical activity (CBPA) programs were used as an example to describe the process. Our team selected an implementation science framework…

This paper summarizes the trends in research about student experiences in out-of-school time (OST) in countries of Europe. The analysis is based on a review of the content of research papers published between 1999 and 2019 in about 36 European countries. OST is recognized as an important aspect of students' educational experiences that deserves…