This program computes specific category agreement levels for both nominally and ordinally scaled data. For ordinally scaled data, an option is available for collapsing the original scale to a smaller number of categories, with the goal of improving the level of interrater reliability for the rating scale. (Author)

Several new programs have been added to those of the Comprehensive Occupational Data Analysis Programs (CODAP), all oriented toward analyzing and manipulating information describing work tasks, rather than jobs or persons. REXALL analyzes the inter-rater agreement among judges concerning task-factor ratings. TSKFAC adds factor weight vectors to…

A statistical method for testing the agreement between a judge's assessment of an object or subject and a known standard is developed and shown to be superior to two other methods which appear in the literature. (Author/JKS)

Procedures for computing content validity and consistency reliability coefficients and determining the statistical significance of these coefficients are described. Procedures employing the multinomial probability distribution for small samples and normal curve probability estimates for large samples, can be used where judgments are made on…