Inter-Annotator AgreementInter-Annotator Agreement • May 13th, 2014
Contract Type FiledMay 13th, 2014Abstract. This paper discusses different methods of estimating the inter-annotator agreement in manual annotation of Polish coreference and proposes a new BLANC-based annotation agreement metric. The commonly used agreement indicators are calculated for mention detec- tion, semantic head annotation, near-identity markup and coreference resolution.