Inter-Rater Agreement under Stratified Random Sampling SchemeResearch Article • August 6th, 2020
Contract Type FiledAugust 6th, 2020Kappa coefficient is a popular statistic to measure the agreement between the classifications of two raters. The estimation of the coefficient and its variance are approximately satisfied by a simple random sampling method. To get more efficient results for confidence interval estimation of kappa, stratified random sampling method can also be used, alternatively. In this study, a bootstrap method under stratified sampling is suggested to use to estimate the confidence interval of the kappa coefficient. The results are discussed over three data sets.