The teacher evaluation process has been an area of study for decades because of its complexity. Going back to one-room schoolhouses, teaching has always been an isolated profession--usually a room, a teacher, and students. Other colleagues or administrators are not participants in the classroom most of the time, which creates difficulties for…

There is presently little consensus on how evaluators evaluate special education teachers. The lack of agreement may be due to the training of evaluators. Special education teachers work under various conditions with a diverse population. In this dissertation, we reviewed the challenges associated with evaluating special education teachers,…

Across the country, school districts are increasingly seeking out privately contracted psychologists to conduct psychological evaluations. As such, it is increasingly important that psychological reports adhere to best practices and are written to ensure comprehension by both parents and teachers. This study explored the potential differences…

Researchers in many disciplines work with ranking data. This data type is unique in that it is often deterministic in nature (the ranks of items "k"-1 determine the rank of item "k"), and the difference in a pair of rank scores separated by "k" units is equivalent regardless of the actual values of the two ranks in…

In this paper we outline the use of a concept mapping narrative method to elicit the complex and interconnected conceptualisations of specialized knowledge (assessment literacy) for a specific cohort of participants (teacher-examiners). In particular, we are interested in exploring how relational concept mapping and narrative interviews can be…

In 2020, because of the COVID-19 pandemic the higher education sector, in the United Kingdom and internationally, transitioned to online assessment, at a speed and scale which might have been unimaginable under normal circumstances. The priority in the sector was to ensure that fundamental principles of assessment, including integrity, were…

Star teachers (Haberman, 1995) maintain high self-efficacy and job satisfaction when working with urban populations (Ford et al. 2020). The purpose of this study was to investigate self-efficacy in regards to urban schools through the criteria of effective urban teachers, or stars. A total of 14 college students majoring in early childhood…

Spurred by "Race to the Top," efforts to improve teacher evaluation systems have provided states with an opportunity to get teacher evaluation right. Despite the fact that a core reform area of "Race to the Top" was the use of teacher evaluation to provide on-going and meaningful feedback for instructional decision making, we…

Teacher perceptions after 5 years of implementing evaluation protocols that were initiated under Race to the Top revealed attitudes about the evaluation instrument used and the nature of their relationship with the evaluator. This study surveyed middle and high school teachers in nine Eastern Tennessee school districts. Data indicated unintended…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

Contribution: This paper shows how significantly computer science instructors can disagree when grading code writing questions in introductory computer science (CS1) exams. Certain solutions are considered "very good" by some instructors and "very bad" by others. The study identifies four factors as possible contributors to…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

Responding to an Illinois law that took effect in 2010, the Performance Evaluation Reform Act (PERA), Chicago Public Schools (CPS) created and implemented the REACH (Recognizing Educators Advancing Chicago's Students) educator evaluation and support system. REACH was piloted in 2012-13. It is still being implemented as of the 2019-20 school year,…

This paper presents the integration of a real time evaluation method of collaboration quality in a monitoring application that supports teachers in class orchestration. The method is implemented as an automatic rater of collaboration quality and studied in a real time scenario of use. We argue that automatic and semi-automatic methods which…

Purpose: The purpose of this study was to develop a better understanding of current PE teachers' perceptions of teacher evaluation systems. Method: A mixed methods approach was used and two sources of data collection were used: (a) a short survey of PE teachers (n = 22) in one urban school district and (b) a formal semistructured interview with 10…