The purpose of this study was to develop a reliable and valid rating scale for the use of the assessment and evaluation of lesson plans and teaching practices that are based on argumentation-based inquiry (ABI). The study covered two academic years (four academic semesters). Qualitative and quantitative methods were utilized throughout the…

Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of…

This brief provides a summary of the validity of Istation ISIP Early Reading scores in predicting students' performance levels on the Idaho Standards Achievement Test (ISAT) in English language arts (ELA). This correlational study analyzed how well third grade students' winter performance on the ISIP Early Reading test predicted their spring…

Teacher candidate performance assessments represent a promising source of data for evidence-based program improvement. However, teacher preparation programs (TPPs) interested in reform face a crucial question: how to identify actionable evidence in performance-assessment data. To address this concern, we propose a two-pronged empirical framework…

The purpose of this study was to evaluate the construct and predictive validity of scores on a measure of social acceptability of class-wide and individual student intervention, the School Intervention Rating Form (SIRF), with high school teachers. Utilizing scores from 158 teachers, exploratory factor analysis revealed a three-factor (i.e.,…

Leaders, policymakers, and systems developers seek to improve early childhood programs through data driven decision-making. Data can be useful for informing continuous quality improvement efforts at the classroom and program level and for creating support for workforce development at the system level. Early childhood program leaders use…

Austin Independent School District (AISD) Social Emotional Learning (SEL) coaches rated schools on the degree to which they implemented 10 domains believed to best exemplify program goals. This study examines the validity and reliability of the implementation rubric they used. A separate full report also was published. [For the full report, see…

Evaluations of teacher preparation programs (TPPs) based in part on the performance of program completers have emerged as an education reform strategy in several states and have become central features of the Race to the Top (RTTT) grant competition. The objective of this policy review is to examine how the state of Tennessee measured and reported…

Due to the growing importance of the professional role of teachers, effective evaluation practices are essential to ensuring highly qualified educators. The problem addressed was how Volusia County School teachers in the state of Florida experienced the teacher evaluation process and how that impacted the effectiveness of instructional practices…

Austin Independent School District (AISD) Social Emotional Learning (SEL) coaches rated schools on the degree to which they implemented 10 domains believed to best exemplify program goals. This study examines the validity and reliability of the implementation rubric they used. A separate research brief report also was published. [For the research…

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

Because of the critical function of the IEP in the planning and implementation of effective instruction for students with disabilities, educators need a reference to determine the standards of a quality IEP and a process by which to compare an IEP to those standards. A rubric can support educators in examining the quality of IEPs. This study used…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

This study examines how GRE scores can be used to better understand Education doctoral candidates' methodology choices for the dissertation as well as their persistence behaviors. Candidates' of one online doctoral education program were examined. Results of a MANOVA suggested that there is no difference in GRE scores based on doctoral candidates'…