Mining recent frequent cooccurring items from transaction stream. (11th February 2020)

• Record Type: Journal Article
• Authors: Misra, Sumit; Thakur, Soumyadeep; Ghosh, Manosij; Saha, Sanjoy Kumar
• Is Part Of: International journal of data science. Volume 4:Number 4(2019)
• Page Start: 288
• Page End: 304
• Publication Date: 2020-02-11
• Subjects: recent frequent item-set -- time decaying count -- item pruning -- stream analytic; Big data -- Periodicals; Data mining -- Periodicals; Information storage and retrieval systems -- Periodicals; Decision making -- Data processing -- Periodicals; 005.7
• Languages: English
• ISSNs: 2053-0811

Abstract

The work presents a simple but novel scheme to determine the recent frequent cooccurring items from transaction streams. It enables to follow the current trend, pattern of occurrence of the items and also help in recommendation. Proposed methodology works on a sequence of transaction forming a time-window. Based on the items present in a transaction, item-sets are formed and encoded. An in-memory structure maintains the frequency of the item-sets. Frequency is time-decayed count that prioritises the recent occurrences. To limit the size of in-memory structure, a pruning operation is carried out to remove the less frequent item-sets. Threshold for pruning is chosen dynamically. Impacts of decaying parameter and window size are also analysed. Experiment has been carried out on two datasets and performance has been compared with two recent works. Proposed methodology provides a better accuracy. Low time and space complexity make it suitable for stream analytic.