Common Contracts
1 similar Inter-Rater Agreement contracts
Joni O. Salminen1, Hind A. Al-Merekhi2, Partha Dey3 and Bernard J. Jansen1Inter-Rater Agreement • April 15th, 2018
In 1954, Bennett et al. [25] proposed an S-score to represent the agreement between two raters where the effect of chance was nullified by subtracting the expected number of chance- agreements. From probability theory, if rater A rates an item into any one of the categories (say i of q), then there is a 1/q chance of rater B too rating that item as the same category (i),completely by chance. This uniform assumption gave rise to the chance-agreement (and subsequent S-score) as :
