Evaluation is a critical component of continuous improvement in education. Robust evaluations enable engaged parties to determine program and intervention impact on key outcomes, identify areas for improvement, and guide future actions. Additionally, as educational systems increasingly focus on data-driven decisionmaking, evaluation becomes even…

This study aimed at understanding and investigating the lived experiences of early childhood teachers' observation practices as a professional tool. Interpretative phenomenological approach was utilized to investigate participants' experiences deeply from their lived experiences. The current study's participants consisted of five early childhood…

One of the biggest challenges that states and local intermediaries face in setting up and scaling high-quality youth apprenticeships is gathering relevant, accurate and actionable data. High-quality data is an essential ingredient for a strong youth apprenticeship program because it equips state and local leaders to evaluate impact, monitor…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

Members of the Data Science Program at George Washington University (GWU) designed and implemented a tuition-free two-week summer camp at GWU for high-school students from the Washington Metro Area. The United States Department of Agriculture (USDA) Office of the Chief Information Officer and his staff were our main partners in the project. The…

This case study is based on a program evaluation of a professional certificate program that trains early childhood care and education providers to build and support young children's emotional literacy. The research project described in the case study will address approaches to methodological combination, justifying research design and changes to…

This project explored the reliability and utility of transcription in coding qualitative data across two studies in a program evaluation context. The first study tested the method of direct audio coding, or coding audio files without transcripts, using qualitative data software. The presence and frequency of codes applied in direct audio coding…

People providing services to schools, teachers, and students want to know whether these services are effective. With that knowledge, a project director can expand services that work well and adjust implementation of activities that are not working as expected. When finding that an innovative strategy benefits students, a project director might…

Since professional learning is about shifting adult mindsets and behavior, it is work that frequently challenges assumptions, expectations, beliefs, instructional practices, and long-standing habits. To have meaningful and productive conversations about evaluation and data, educators must be equipped with effective practices and tools that allow…

Analysis of student-level data to inform policy and promote student success is a core function of executive higher education agencies. Postsecondary data systems have expanded their collection of data elements for use by policymakers, institutional staff and the general public. State coordinating and governing boards use these data systems for…

Interest in the regression discontinuity (RD) design as an alternative to randomized control trials (RCTs) has grown in recent years. There is little practical guidance, however, on conditions that would lead to a successful RD evaluation or the utility of studies with underpowered RD designs. This article describes the use of RD design to…

Purpose: School-based speech-language pathologists (SLPs) are often asked to adopt new policies or practices at the school, district, or state level. Professional learning (PL) opportunities usually accompany these changes but are often delivered in a one-size-fits-all workshop format. The authors challenge school-based SLPs and district…

While designs of professional learning have expanded exponentially beyond the required-attendance inservice day workshop model, infusing meaningful data into daily decisions and conversations has not gained as much traction. Leaders of professional learning are increasingly coming under pressure to demonstrate that evidence is not an anathema in…

School counselors participated in a study examining their program evaluation interest and skills. Findings suggest that school counselors understand the importance of program evaluation, yet they may lack the skills and confidence to successfully engage in program evaluation activities. Professional development training may be an important method…

For many districts, evaluation is an afterthought to implementing a new initiative. Educators participate in professional learning experiences, apply what they learn to their practice, and then, at some point, school and district staff begin wondering if the initiative is making a difference. Then they scramble for nuggets of data that provide any…