Why are these similar? Investigating item similarity types in a large digital library. (5th May 2015)

• Record Type: Journal Article
• Authors: Gonzalez‐Agirre, Aitor; Rigau, German; Agirre, Eneko; Aletras, Nikolaos; Stevenson, Mark
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 67:Number 7(2016:Jul.)
• Page Start: 1624
• Page End: 1638
• Publication Date: 2015-05-05
• Subjects: information retrieval -- natural language processing -- similarity; Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.23482
• Languages: English
• ISSNs: 2330-1635

Abstract

Abstract : We introduce a new problem, identifying the type of relation that holds between a pair of similar items in a digital library. Being able to provide a reason why items are similar has applications in recommendation, personalization, and search. We investigate the problem within the context of Europeana, a large digital library containing items related to cultural heritage. A range of types of similarity in this collection were identified. A set of 1, 500 pairs of items from the collection were annotated using crowdsourcing. A high intertagger agreement (average 71.5 Pearson correlation) was obtained and demonstrates that the task is well defined. We also present several approaches to automatically identifying the type of similarity. The best system applies linear regression and achieves a mean Pearson correlation of 71.3, close to human performance. The problem formulation and data set described here were used in a public evaluation exercise, the *SEM shared task on Semantic Textual Similarity. The task attracted the participation of 6 teams, who submitted 14 system runs. All annotations, evaluation scripts, and system runs are freely available.1