Evaluation capacity building (ECB) is an essential element for generating credible and actionable evidence on Extension programs. This paper offers a discussion of ECB efforts in Cooperative Extension and how such efforts enable Extension professionals to collect and use credible and actionable evidence on the quality and impacts of programs.…

Advances in validity theory and alacrity in validation practice have suffered because the term "validity" has been used to refer to two incompatible concerns: (1) the degree of support for specified interpretations of test scores (i.e. intended score meaning) and (2) the degree of support for specified applications (i.e. intended test…

The expectation for accountability is legitimate. In order to have the desired effects, evidence of what students know and can do must respond to genuine institutional needs and priorities. Far too often, that condition is not met. On too many campuses, assessment activity is mired in a culture of compliance rather than driven by collective…

Systems of accountability are "second order" ways of using evidence of the standard to which "first order" tasks are carried out for a great variety of purposes. However, more accountability is not always better, and processes of holding to account can impose high costs without securing substantial benefits. At their worst,…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Data-based decision making is all the rage. Secretary of Education Arne Duncan (2009) has emphatically declared, "I am a deep believer in the power of data to drive our decisions. Data gives us the roadmap to reform. It tells us where we are, where we need to go, and who is most at risk." In the past few years, all 50 states have adopted most or…

Since taking office, the President has emphasized the need to use evidence and rigorous evaluation in budget, management, and policy decisions to make government work effectively. This need has only grown in the current fiscal environment. Agencies should demonstrate the use of evidence throughout their Fiscal Year (FY) 2014 budget submissions.…

There is an increasing emphasis on evidence-based education, and the sciences of learning are progressing rapidly. But are reports, guidelines, and outreach enough to disseminate this knowledge and affect educational practice? In fact, policy makers and the public often resist evidence-based recommendations about education. This article suggests…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

In April 2011, the U.S. Department of Health and Human Services (HHS) Office of the Assistant Secretary for Planning and Evaluation (ASPE) hosted a Forum, Emphasizing Evidence-Based Programs for Children and Youth, to convene the nation's leading practitioners and researchers with experience using and evaluating an array of evidence-based…

The term "data-based decision making" (DBDM) has become pervasive in education and typically refers to the use of data to make decisions in schools, from assessment of an individual student's academic progress to whole-school reform efforts. Research suggests that special education teachers who use progress monitoring data (a DBDM…

The articles in this issue call for a deeper and better understanding of data, their use, the conditions that are most conducive for using data well, how individuals and groups of practitioners make sense of the data before them, and the intended and unintended consequences of data use for school improvement. The authors together craft important…

Just one of the ways career and technical education (CTE) is revamping its image is through increased attention to data-driven instructional techniques as a means of improving and focusing instruction on what matters most. Accountability and data have increasingly become a core focus of research, news, and commentary about education in recent…

Correlations between self-reported learning gains and direct, longitudinal measures that ostensibly correspond in content area are generally inadequate. This chapter clarifies that self-reported measures of learning are more properly used and interpreted as evidence of students' perceived learning and affective outcomes. In this context, the…

The Transformative Change Initiative (TCI) is dedicated to assisting community colleges to scale up innovation in the form of guided pathways, programs of study, and evidence-based strategies to improve student outcomes and program, organization, and system performance. The impetus for TCI is the Trade Adjustment Assistance Community College and…