A reduced variance unsupervised ensemble learning algorithm based on modern portfolio theory. (15th October 2021)

• Record Type: Journal Article
• Authors: Ünlü, Ramazan; Xanthopoulos, Petros
• Is Part Of: Expert systems with applications. Volume 180(2021)
• Publication Date: 2021-10-15
• Subjects: consensus clustering -- ensemble learning -- internal quality measures -- Markowitz's portfolio theory; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.115085
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: This is the first consensus clustering method that takes variance under consideration. This is the first application of modern portfolio theory in ensemble learning. The algorithm provides reduced variance solutions without a lot of performance sacrifice. Algorithm is extensively tested in multiple benchmark instances. Abstract: Unsupervised ensemble learning or consensus clustering has gained popularity due to its ability to combine multiple clustering solutions into a single solution that is robust and often performs better than the individual ones. There have been several approaches to consensus clustering including voting and weighted voting algorithmic schemes. Although there have been several algorithms for adjusting the weights of a consensus clustering all of them are tuned based on some performance characteristic associated with clustering accuracy. In this paper, we propose a method for incorporating weights by taking into consideration the intra algorithmic variability i.e. algorithms that provide solutions with very different performance upon multiple runs. The methodology is inspired by modern portfolio theory and more specifically from Markowitz model for asset allocation where one is trying to identify the most efficient portfolio through the solution of a convex optimization problem. Here, efficiency is defined as the minimum amount of risk for an expected return. We apply this method to different datasets and compare with respect to performance and robustness. The proposed scheme appears to achieve competitive average performance with very low variability.