A survey on machine learning from few samples. (July 2023)

• Record Type: Journal Article
• Authors: Lu, Jiang; Gong, Pinghua; Ye, Jieping; Zhang, Jianwei; Zhang, Changshui
• Is Part Of: Pattern recognition. Volume 139(2023)
• Publication Date: 2023-07
• Subjects: Few sample learning -- Learn to learn -- Survey -- Few-shot learning -- Meta learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2023.109480
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Cover all FSL papers from the 2000s to now, elaborate its evolution history. Give an understandable hierarchical taxonomy for FSL approaches. Categorize meta learning FSL methods and reveal their underlying relationship. Analyze several emerging extensional research hotspots of FSL. Conclude existing FSL applications and its future directions. Abstract: The capability of learning and generalizing from very few samples successfully is a noticeable demarcation separating artificial intelligence and human intelligence. Despite the long history dated back to the early 2000s and the widespread attention in recent years with booming deep learning, few surveys for few sample learning (FSL) are available. We extensively study almost all papers of FSL spanning from the 2000s to now and provide a timely and comprehensive survey for FSL. In this survey, we review the evolution history and current progress on FSL, categorize FSL approaches into the generative model based and discriminative model based kinds in principle, and emphasize particularly on the meta learning based FSL approaches. We also summarize several recently emerging extensional topics of FSL and review their latest advances. Furthermore, we highlight the important FSL applications covering many research hotspots in computer vision, natural language processing, audio and speech, reinforcement learning and robotic, data analysis, etc. Finally, we conclude the survey with a discussion on promising trends in the hope of providing guidance and insights to follow-up researches.