Common Contracts
3 similar Research Paper contracts
annotator agreement on coherence relation anno-Research Paper • April 12th, 2022
When annotating coherence relations, inter- annotator agreement tends to be lower on im- plicit relations than on relations that are ex- plicitly marked by means of a connective or a cue phrase. This paper explores one possi- ble explanation for this: the additional infer- encing involved in interpreting implicit rela- tions compared to explicit relations. If this is the main source of disagreements, agreement should be highly related to the specificity of the connective. Using the CCR framework, we annotated relations from TED talks that were marked by a very specific marker, marked by a highly ambiguous connective, or not marked by means of a connective at all. We indeed reached higher inter-annotator agreement on explicit than on implicit relations. However, agreement on underspecified relations was not necessarily in between, which is what would be expected if agreement on implicit relations mainly suffers because annotators have less specific instructions for inferring the relatio
annotator agreement on coherence relation anno-Research Paper • October 3rd, 2021
When annotating coherence relations, inter- annotator agreement tends to be lower on im- plicit relations than on relations that are ex- plicitly marked by means of a connective or a cue phrase. This paper explores one possi- ble explanation for this: the additional infer- encing involved in interpreting implicit rela- tions compared to explicit relations. If this is the main source of disagreements, agreement should be highly related to the specificity of the connective. Using the CCR framework, we annotated relations from TED talks that were marked by a very specific marker, marked by a highly ambiguous connective, or not marked by means of a connective at all. We indeed reached higher inter-annotator agreement on explicit than on implicit relations. However, agreement on underspecified relations was not necessarily in between, which is what would be expected if agreement on implicit relations mainly suffers because annotators have less specific instructions for inferring the relatio
annotator agreement on coherence relation anno-Research Paper • September 10th, 2021
When annotating coherence relations, inter- annotator agreement tends to be lower on im- plicit relations than on relations that are ex- plicitly marked by means of a connective or a cue phrase. This paper explores one possi- ble explanation for this: the additional infer- encing involved in interpreting implicit rela- tions compared to explicit relations. If this is the main source of disagreements, agreement should be highly related to the specificity of the connective. Using the CCR framework, we annotated relations from TED talks that were marked by a very specific marker, marked by a highly ambiguous connective, or not marked by means of a connective at all. We indeed reached higher inter-annotator agreement on explicit than on implicit relations. However, agreement on underspecified relations was not necessarily in between, which is what would be expected if agreement on implicit relations mainly suffers because annotators have less specific instructions for inferring the relatio
