Adjudication of coreference annotations via answer set optimisation. Issue 4 (4th July 2018)

• Record Type: Journal Article
• Authors: Schüller, Peter
• Is Part Of: Journal of experimental & theoretical artificial intelligence. Volume 30:Issue 4(2018)
• Page Start: 525
• Page End: 546
• Publication Date: 2018-07-04
• Subjects: Coreference resolution -- adjudication -- answer set programming; Artificial intelligence -- Periodicals; 006.3
• DOI: 10.1080/0952813X.2018.1456793
• Languages: English
• ISSNs: 0952-813X

Abstract

Abstract: We describe the first automatic approach for merging coreference annotations obtained from multiple annotators into a single gold standard. This merging is subject to certain linguistic hard constraints and optimisation criteria that prefer solutions with minimal divergence from annotators. The representation involves an equivalence relation over a large number of elements. We use Answer Set Programming to describe two representations of the problem and four objective functions suitable for different data-sets. We provide two structurally different real-world benchmark data-sets based on the METU-Sabanci Turkish Treebank and we report our experiences in using the Gringo, Clasp and Wasp tools for computing optimal adjudication results on these data-sets.