Detection of Annotation Errors in Corpora. Issue 3 (March 2015)

• Record Type: Journal Article
• Authors: Dickinson, Markus
• Is Part Of: Language and linguistics compass. Volume 9:Issue 3(2015)
• Page Start: 119
• Page End: 138
• Publication Date: 2015-03
• Subjects: Language and languages -- Periodicals; Linguistics -- Periodicals; Applied linguistics -- Periodicals; Linguistique -- Périodiques; Linguistique appliquée -- Périodiques; Langage et langues -- Périodiques; 400
• DOI: 10.1111/lnc3.12129
• Languages: English
• ISSNs: 1749-818X

Abstract

<abstract abstract-type="main"> <title>Abstract</title> <p>This paper surveys methods for annotation error detection and correction. Methods can broadly be characterized as to whether they detect inconsistencies with respect to some statistical model based only on the corpus data or whether they detect inconsistencies with respect to a grammatical model, in general, some external information source. Two extended examples are presented, illustrating these different techniques: (1) the variation <italic>n</italic>‐gram method, which searches for inconsistences in annotation for identical strings; and (2) a method of <italic>ad hoc rule detection</italic>, for syntactic annotation, which compares treebank rules to a grammar to determine which are anomalous. Methods for detecting annotation errors have developed much over the last decade, and thus corpus practitioners can benefit greatly from them, while at the same time NLP researchers can learn more about the nuances of the annotation they use and see how error correction methods intersect with NLP techniques.</p> </abstract>