A Survey on Concept Factorization: From Shallow to Deep Representation Learning. Issue 3 (May 2021)

• Record Type: Journal Article
• Authors: Zhang, Zhao; Zhang, Yan; Xu, Mingliang; Zhang, Li; Yang, Yi; Yan, Shuicheng
• Is Part Of: Information processing & management. Volume 58:Issue 3(2021)
• Publication Date: 2021-05
• Subjects: Survey -- Concept factorization -- Representation learning -- Traditional single-layer CF -- Deep/multilayer CF; Information storage and retrieval systems -- Periodicals; Information science -- Periodicals; Systèmes d'information -- Périodiques; Sciences de l'information -- Périodiques; Information science; Information storage and retrieval systems; Periodicals; 658.4038
• DOI: 10.1016/j.ipm.2021.102534
• Languages: English
• ISSNs: 0306-4573

Abstract

Highlights: Wepresenta survey on concept factorization: from shallow to deep representation learning. We survey the recent advances in CF methodologies and potential benchmarks by categorizing and summarizing the current methods. We first review the root CF model, and then explorethe advancement of CF-based representation learning methods ranging from shallow to deep/multilayer cases. Finally, we point out some future directions for CF-based representation learning. Overall, this survey mainly aims to provide an insightful overview of theoretical basis and current developments in the field of CF. Abstract: The quality of obtained features by representation learning determines the performance of a learning algorithm and subsequent application tasks (e.g., high-dimensional data clustering). As an effective paradigm for learning representations, Concept Factorization (CF) has attracted a great deal of interests in the areas of machine learning and data mining for over a decade. Moreover, lots of effective CF-based methods have been proposed based on different perspectives and properties, but it still remains not easy to grasp the essential connections and figure out the underlying explanatory factors from current studies. In this paper, we therefore survey the recent advances on CF methodologies and the potential benchmarks by categorizing and summarizing current methods. Specifically, we first review the root CF method, and then explore the advancement of CF-based representation learning ranging from shallow to deep/multilayer cases. We also introduce the potential application areas of CF-based methods. Finally, we point out some future directions for studying the CF-based representation learning. Overall, this survey provides an insightful overview of both theoretical basis and current developments in the field of CF, which can also help the interested researchers to understand the current trends of CF and find the most appropriate CF techniques to deal with particular applications.