A Winner‐Take‐All Autoencoder Based Pieceswise Linear Model for Nonlinear Regression with Missing Data. Issue 12 (5th August 2021)

• Record Type: Journal Article
• Authors: Zhu, Huilin; Ren, Yanni; Tian, Yanling; Hu, Jinglu
• Is Part Of: IEEJ transactions on electrical and electronic engineering. Volume 16:Issue 12(2021)
• Page Start: 1618
• Page End: 1627
• Publication Date: 2021-08-05
• Subjects: missing data -- stacked denoising autoencoders -- piecewise linear model -- quasi‐linear kernel; Electrical engineering -- Periodicals; Electronics -- Periodicals; 621.3
• DOI: 10.1002/tee.23466
• Languages: English
• ISSNs: 1931-4973

Abstract

Abstract: Missing data is a prevailing problem in predictive analytics. In this paper, a winner‐take‐all (WTA) autoencoder‐based piecewise linear model is developed to solve the nonlinear regression problem under the missing value scenario, which consists of two parts: an overcomplete WTA autoencoder and a gated linear network. The overcomplete WTA autoencoder is a stacked denoising autoencoder (SDAE) designed to play two roles: (1) to estimate the missing values; (2) to realize a sophisticated partitioning by generating a broad set of binary gate control sequences. Besides, an iterative algorithm with renewed teacher signals is developed to train the SDAE. On the other hand, the gated linear network with the generated binary gate control sequences implements a flexible piecewise linear model for nonlinear regression. By composing a quasi‐linear kernel based on the gate control sequences, the piecewise linear model is then identified in the same way as a support vector regression. Experimental results have shown that our proposed hybrid model has a better performance than traditional models. © 2021 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.