Mining of frequent patterns with multiple minimum supports. (April 2017)

• Record Type: Journal Article
• Authors: Gan, Wensheng; Lin, Jerry Chun-Wei; Fournier-Viger, Philippe; Chao, Han-Chieh; Zhan, Justin
• Is Part Of: Engineering applications of artificial intelligence. Volume 60(2016:Dec.)
• Page Start: 83
• Page End: 96
• Publication Date: 2017-04
• Subjects: Frequent patterns -- Multiple minimum supports -- Sorted downward closure property -- Set-enumeration-tree -- DiffSet; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2017.01.009
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Frequent pattern mining (FPM) is an important topic in data mining for discovering the implicit but useful information. Many algorithms have been proposed for this task but most of them suffer from an important limitation, which relies on a single uniform minimum support threshold as the sole criterion to identify frequent patterns (FPs). Using a single threshold value to assess the usefulness of all items in a database is inadequate and unfair in real-life applications since each item is different and not all items should be treated as the same. Several algorithms have been developed for mining FPs with multiple minimum supports but most of them suffer from the time-consuming problem and require a large amount of memory. In this paper, we address this issue by introducing the novel approach namedF requentP attern mining withM ultiple minimum supports from theE numeration-tree (FP-ME). In the developed Set-E numeration-tree withM ultiple minimum supports (ME-tree) structure, a new sorted downward closure ( SDC ) property of FPs and the least minimum support ( LMS ) concept with multiple minimum supports are used to effectively prune the search space. The proposed FP-ME algorithm can directly discover FPs from the ME-tree without candidate generation. Moreover, an improved algorithm, named FP-MEDiffSet, is also developed based on the DiffSet concept, to further increase mining performance. Substantial experiments on both real-life and synthetic datasets show that the proposed algorithms can not only avoid the " rare item problem ", but also efficiently and effectively discover the complete set of FPs in transactional databases while considering multiple minimum supports and outperform the state-of-the-art CFP-growth++ algorithm in terms of execution time, memory usage and scalability.