Attribute and instance weighted naive Bayes. (March 2021)

• Record Type: Journal Article
• Authors: Zhang, Huan; Jiang, Liangxiao; Yu, Liangjun
• Is Part Of: Pattern recognition. Volume 111(2021)
• Publication Date: 2021-03
• Subjects: Naive Bayes -- Attribute weighting -- Instance weighting -- Eager learning -- Lazy learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107674
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Many different categories of approaches have been proposed to improve naive Bayes. Few works simultaneously pay attention to attribute weighting and instance weighting. We propose attribute and instance weighted naive Bayes (AIWNB) in this paper. To learn AIWNB, we propose an eager and a lazy algorithms: AIWNB E and AIWNB L . The experimental results validate the effectiveness of the proposed algorithms. Abstract: Naive Bayes (NB) continues to be one of the top 10 data mining algorithms, but its conditional independence assumption rarely holds true in real-world applications. Therefore, many different categories of improved approaches, including attribute weighting and instance weighting, have been proposed to alleviate this assumption. However, few of these approaches simultaneously pay attention to attribute weighting and instance weighting. In this study, we propose a new improved model called attribute and instance weighted naive Bayes (AIWNB), which combines attribute weighting with instance weighting into one uniform framework. In AIWNB, the attribute weights are incorporated into the naive Bayesian classification formula, and then the prior and conditional probabilities are estimated using instance weighted training data. To learn instance weights, we single out an eager approach and a lazy approach, and thus two different versions are created, which we denote as AIWNB E and AIWNB L, respectively. Extensive experimental results show that both AIWNB E and AIWNB L significantly outperform NB and all the other existing state-of-the-art competitors.