Publication Date:
2018
abstract:
Agreement indexes are widely used in Computational Linguistics and NLP to assess the reliability of annotation tasks. The paper aims at reviewing the literature on the topic, illustrating chance-corrected coefficients and their interpretation.
Iris type:
4.1 Contributo in Atti di convegno
Keywords:
Agreement; Inter-annotator agreement; inter-tagger agreement; inter-rater agreement; reliability; annotation
List of contributors:
Gagliardi, Gloria
Book title:
Proceedings of the Fifth Italian Conference on Computational Linguistics (CLiC-it 2018)