This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed three key properties of the FFL: internal consistency, score variation, and concurrent validity. To measure the internal consistency…

This report describes statistical analyses performed on data collected in the Spring of 2015 from the pilot study of proposed revised and new items in the IDEA Student Ratings of Instruction (SRI) system. Described are the methods employed, results obtained, and decisions made in selecting items for the updated instruments. The procedures occurred…

This report describes the processes undertaken to revise the IDEA Student Ratings of Instruction (SRI) system. The previous revision occurred in 1999, as described in IDEA Technical Report No. 11, "Revising the IDEA System for Obtaining Student Ratings of Instructors and Courses" (Hoyt, Chen, Pallett, & Gross, 1999). The procedures…

The Commonwealth of Pennsylvania plans to develop a new statewide evaluation system for teachers and principals in its public schools by school year 2013-2014. To inform the development of this evaluation system, the Team Pennsylvania Foundation (Team PA) undertook the first phase of the Pennsylvania Teacher and Principal Evaluation…

This study investigated the relationship between the dimensionality of behaviorally anchored scales during construction and during their use. It was hypothesized that as the agreement among raters in assigning behaviors to dimensions increased, there would be an increase in the stability of the structure of the dimensions and in their independence…

At Golden College (California), student writing samples are holistically scored by pairs of judges on a six-point scale. Judges are allowed to use plus and minus figures, thus converting the integer scale to a decimal scale of evaluation. In 1991, 499 writing samples written as part of the placement testing process for students in the Coast…

This report contains accounts of studies, about scales to be used in the "A Study of Schooling" research project, undertaken to derive indices for constructs presumed to be measureable by composites of items. The report is introduced by a discussion on the rationale for selecting the research methodology used and an explanation of the…

In 2004, the Lumina Foundation for Education approved a generous grant to support validation research to explore and document the validity of the Community College Student Report (CCSR), add to the higher education field's understanding of student engagement, and help to identify research or institutional practices that require further attention.…