A small subset of education studies analyzes school data collected seasonally (separating the summer from the school year). At first, this work was primarily known for documenting learning loss in the summers, but scholars have since recognized that observing how inequality changes between summer and school periods provides leverage for…

Treatment fidelity data are critical to evaluate intervention effectiveness, yet there are only general guidelines regarding treatment fidelity measurement. Initial investigations have found treatment fidelity data collected via direct observation to be more reliable than data collected via permanent product or self-report. However, the comparison…

Bridge International Academies, the largest network of elementary schools in the developing world operates both low-cost private schools, and public-private partnership schools. More than 800,000 students are enrolled in 2,026 schools in five countries. Bridge tries lots of different ideas and initiatives, many of which are backed up by research…

With the aim to provide teachers with more specific, frequent, and actionable feedback about their teaching, we explore how Large Language Models (LLMs) can be used to estimate "Instructional Support" domain scores of the CLassroom Assessment Scoring System (CLASS), a widely used observation protocol. We design a machine learning…

Multiple data collection or research methods exist for evaluating library spaces. Faced with numerous choices and limited time for gathering data, it becomes challenging for information professionals to determine the best way to proceed with evaluating their libraries' physical spaces. There is a gap in the literature on best practices for…

As states consider non-academic measures of school quality for their accountability plans under the Every Student Succeeds Act, few are choosing to focus on the school climate in which students learn. That's not a surprise, given concerns about the validity and usefulness of existing climate surveys. However, the authors argue, a recent study…

Despite growing interest in formative assessment of teacher practices, research on rates of change in teachers' practices is sparse. This is the first study to examine the characteristics of observed change in classroom practices using the Classroom Strategies Assessment System (CSAS) across alternative schedules of data collection during…

Vocational education aims at preparing students for their future as professionals; thus, students are often required to undergo a form of on-the-job learning. Assessment of professional performance during on-the-job learning is not based on single observations, but on prolonged participation at the workplace culminating in judgement by a workplace…

This exploratory multi-case study investigates the types of teacher performance data principals consider and collect when evaluating teachers. Data come from public school principals (N = 10) in the U.S. state of Michigan and includes: interviews (n = 30), observations (n = 20), and artifacts collected in 2016 and 2017. Additionally, specific…

In many countries, assessment and curriculum reforms came into being in recent decades. In Iran, an important educational assessment reform took place called Descriptive Assessment (DA). In this reform, the focus of student assessment was moved from a more summative approach of providing grades and deciding about promotion to the next grade to a…

Systematic direct observation (SDO) is frequently used in schools to document student response to evidence-based interventions, determine eligibility for special education services, and provide objective data during high-stakes decisions. However, there are several limitations associated with this widely used data collection tool including a…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Various educational mandates, including the Individuals with Disabilities Education Act (IDEA) and No Child Left Behind (NCLB), and educational approaches, such as Response to Intervention (RTI) and Positive Behavior Supports (PBS), require use of objective data to inform decision making for academics and behavior. However, some traditional…

Rhode Island is committed to ensuring that all educators receive fair, accurate, and meaningful educator evaluations that provide information that can help all teachers improve and refine their practice. Currently, districts in Rhode Island may submit a district-designed model for approval that complies with the Educator Evaluation System…

Teaching is a complex construct, and there is near-universal consensus, in the literature in the United States and internationally, that capturing this complexity requires collecting multiple measures from multiple sources. Yet, what measures to use and how is a contentious area of education policy research. In practice, there is little specific…