Partial materialization for online analytical processing over multi-tagged document collections. Issue 3 (June 2016)

• Record Type: Journal Article
• Authors: Drzadzewski, Grzegorz; Tompa, Frank
• Is Part Of: Knowledge and information systems. Volume 47:Issue 3(2016:Jun.)
• Page Start: 697
• Page End: 732
• Publication Date: 2016-06
• Subjects: Document warehouse -- Document tags -- Text analytics -- Selective materialization -- OLAP -- Faceted browsing; Expert systems (Computer science) -- Periodicals; Information storage and retrieval systems -- Periodicals; 006.33
• DOI: 10.1007/s10115-015-0871-2
• Languages: English
• ISSNs: 0219-1377

Abstract

Abstract The New York Times Annotated Corpus, the ACM Digital Library, and PubMed are three prototypical examples of document collections in which each document is tagged with keywords or phrases. Such collections can be viewed as high-dimensional document cubes against which browsers and search systems can be applied in a manner similar to online analytical processing against data cubes. After examining the tagging patterns in these collections, a partial materialization strategy is developed to provide efficient storage and access to centroids for document subsets that are defined through queries over tags. By adopting this strategy, summary measures dependent on centroids (including measures involving medoids, sets of representative documents, or sets of representative terms) can be efficiently computed. The proposed design is evaluated on the three collections and on several synthetically generated collections to validate that it outperforms alternative storage strategies.