This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics.…

To determine if individuals other than first-line supervisors could be used as expert judges in making estimates of job performance worth when conducting a utility analysis, this study compared the estimates of experienced job incumbents with those of supervisors. The job class investigated was that of eligibility technician, who performs varied…

The effectiveness of the current selection system used to hire eligibility technicians was studied, and the predictive relationship between existing selection instruments and job performance criteria was investigated. Eligibility technicians are employees of San Diego County (California) whose duties include determining the eligibility of…