Each year, Austin Independent School District Department of Research and Evaluation (DRE) staff develop a plan of work to describe the scope of work for the coming year. The plans that make up this document identify programs to be evaluated and services to be provided by DRE staff and provide the blueprints for evaluation that staff will follow…

Evaluation policy has been identified as an important means of shaping and influencing organizational evaluation practice, yet, to date, little empirical research has been conducted to deepen our understanding of this relationship. The purpose of this study was to illuminate evaluation policy's role in leveraging organizational capacity to do and…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

This study focuses on the effect of the programme variable on the purposes and effects that students associate with assessment, on the assessment methods used and on the perceived use of assessment. Data were collected in five Portuguese Public Universities through a survey (n = 4144) and focus group (n = 250) with students enrolled in different…

The roles in traditional mentoring dyads are well known across both academic and professional contexts (Dawson, 2014). Despite the universality of these relationships, the way mentorship is evaluated in these relationships is fractured. Evaluation is limited to singular voices, singular points in time and simplified metrics to capture the journey…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

Early Childhood Comprehensive Systems (ECCS) grants help states and communities improve early childhood systems to support child development, equitable access to quality services and supports, and family well-being. Truly interdisciplinary, ECCS promotes cross-sector systems change initiatives that focus on integrating health care, mental health,…

Graduate higher education coverage has expanded worldwide due to globalisation, the demand for more specialised human resources and online education, exacerbated by the COVID-19 pandemic. This article validates an evaluation model of academic service quality in graduate studies that integrates HiEduQual instruments with the Kano method for…

Kuh and colleagues (2008) use the term "high-impact practices" (HIPs) to describe co-curricular programs that are particularly effective in advancing student learning. The original list of HIPs does not include campus employment, which McClellan et al. (2018) argued should be added. According to the results from the 2019 NASPA survey…

Systemic racism is pervasive in US society and disproportionately limits opportunities for education, work, and health for historically marginalized and minoritized racial and ethnic groups, making it an urgent issue of social justice. Because systemic racism is a social determinant of health prevalent across multiple social and institutional…

A growing number of countries has a strong interest in assessing the quality of their talent-support systems. We propose combining two relevant conceptual frameworks -- hemerotopes and the learning and educational capital approach -- to better achieve this end. Hemerotopes provide qualitative categories for assessing the degree to which countries…

This paper explores using data mining in English teaching assessment in higher education within the 'Internet + Education' era. Traditional assessment methods struggle to meet modern teaching needs. By collecting diverse data like student performance and learning behavior, and employing data mining, a comprehensive assessment model is built. This…

Is assessment a top-down bureaucratic mandate, an undertaking that seems to have little to do with improving practice, an inauthentic activity that frustrates and disempowers, an afterthought? Or is it a process embraced and enacted together by all stakeholders as a means to learn and grow and enact change in the world? The authors of the…

Multi-Tiered System of Supports (MTSS) is an integrated system of high quality, standards-based instruction and interventions that are matched to students' academic, social-emotional, and behavioral needs. The framework relies on strong core instruction and layered tiers of supports for all needs of the whole child, with a focus on equity and…

Project schedules are logic models that focus on the timing of program activities. Value derives from the fact that schedule changes are not random. Why they occur, and how long they last, can reveal information that would not be easily revealed with other approaches to evaluation. Also, using project schedules as logic models forges a strong link…