This study examines the assessor data collected from the 2016 Resident Educator Summative Assessment. The assessor scored teacher observations on a 4 level rubric. The data is specific to the calibration tests and validity cases that are included in the scoring platform. The 235 assessors scores were compared to the master coders scores (dependent variable) on the tests and cases. This quantitative study used a percent agreement, kappa and weighted kappa to determine accuracy and was delineated across four independent variables: gender, years of teaching, frequency rate of scoring, and total number of submissions scored. The analysis showed there was a significance for the following characteristics in both the calibration tests and validation cases: frequency rate of scoring and total number of submissions scored. These findings were supported by the literature review. This data is beneficial to the educational community including teachers, leaders, and educator preparation institutions. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]