Rater-mediated assessments are a common methodology for measuring persons, investigating rater behavior, and/or defining latent constructs. The purpose of this article is to provide a pedagogical framework for examining rater variability in the context of rater-mediated assessments using three distinct models. The first model is the observation…

With the aim to provide teachers with more specific, frequent, and actionable feedback about their teaching, we explore how Large Language Models (LLMs) can be used to estimate "Instructional Support" domain scores of the CLassroom Assessment Scoring System (CLASS), a widely used observation protocol. We design a machine learning…

Responding to an Illinois law that took effect in 2010, the Performance Evaluation Reform Act (PERA), Chicago Public Schools (CPS) created and implemented the REACH (Recognizing Educators Advancing Chicago's Students) educator evaluation and support system. REACH was piloted in 2012-13. It is still being implemented as of the 2019-20 school year,…

The number of articles showing dissatisfaction with the null hypothesis statistical testing (NHST) framework has been progressively increasing over the years. Alternatives to NHST have been proposed and the Bayesian approach seems to have achieved the highest amount of visibility. In this last part of the special issue, a few alternative…

An alternative to null hypothesis significance testing is presented and discussed. This approach, referred to as observation-oriented modeling, is centered on model building in an effort to explicate the structures and processes believed to generate a set of observations. In terms of analysis, this novel approach complements traditional methods…

State and local education agencies across the United States are increasingly adopting rigorous teacher evaluation systems. Most systems formally incorporate teacher performance as measured by student test-score growth, sometimes by state mandate. An important consideration that will influence the long-term persistence and efficacy of these systems…

Evaluation denotes the monitoring of progress towards desired goals and objectives. The purpose of this study was to evaluate educational quality at schools using Stufflebeam's CIPP evaluation model (1983). The population comprised the principal, heads of each wing and teachers of various branches of a Welfare School System in Rawalpindi. Data…

Rhode Island is committed to ensuring that all educators receive fair, accurate, and meaningful educator evaluations that provide information that can help all teachers improve and refine their practice. Currently, districts in Rhode Island may submit a district-designed model for approval that complies with the Educator Evaluation System…

Recent research on multiple measures of teaching effectiveness has redefined the role of in-classroom observations in teacher evaluation systems. In particular, most states now mandate that teachers are observed on multiple occasions during the school year, and it is increasingly common that multiple raters are utilized across the different rating…

This article draws on current literature leading to the development of a holistic framework to support practitioners in observation and assessment of childrens evolving inquiry skills. Evidence from the 2011 Trends in International Maths and Science Study (TIMSS) in England identifies a decline of year five student achievement in science. A…

Teacher appraisal has been widely practised in China for decades. With the introduction, in 2009, of the teacher performance pay system, however, teacher appraisal has undergone certain changes. This study explores the practice of teacher appraisal, using a qualitative approach and taking public schools in Shanghai as its research sites. The…

Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…

The present study aimed to represent the innovative assessments that support students' learning in STEM education through using the integrative framework for Cognitive Diagnostic Modeling (CDM). This framework is based on three components, cognition, observation, and interpretation (National Research Council, 2001). Specifically, this dissertation…

A key question facing teacher evaluation systems is how to combine multiple measures of complex constructs into composite indicators of performance. We use data from the Measures of Effective Teaching (MET) study to investigate the measurement properties of composite indicators obtained under various conjunctive, disjunctive (or complementary),…

NCLB waiver requirements have led to development of teacher evaluation systems, in which student growth is a significant component. Recent empirical research has been focusing on metrics of student growth--value-added scores in particular--and their relationship to other metrics. An extensive set of recent teacher-evaluation studies conducted by…