EAGAN: Event‐based attention generative adversarial networks for optical flow and depth estimation. Issue 7 (14th June 2022)

• Record Type: Journal Article
• Authors: Lin, Xiuhong; Yang, Chenhui; Bian, Xuesheng; Liu, Weiquan; Wang, Cheng
• Other Names: Geo Yulan guestEditor.; Wang Hanyun guestEditor.; Clark Ronald guestEditor.; Berrett Stefano guestEditor.; Bennamoun Mohammed guestEditor.
• Is Part Of: IET computer vision. Volume 16:Issue 7(2022)
• Page Start: 581
• Page End: 595
• Publication Date: 2022-06-14
• Subjects: Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/cvi2.12115
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract: Event camera is a new vision sensor that produces independent asynchronous responses to each pixel's change of illumination intensity. The unique principle of event camera has many advantages over traditional cameras, such as low latency, high temporal resolution, and high dynamic range (HDR). These advantages make event camera ideal for dealing with high speed, HDR visual tasks, especially in automatic driving scenes. In this study, we propose an image generation network named Event‐based attention generative adversarial networks (EAGAN), which simultaneously deals with optical flow and depth estimation of monocular event camera data. In addition to the innovative network architecture and loss function suitable for depth estimation, we are also the first to process incomplete training data to obtain more dense and uniform prediction results. Experiments on the multi‐vehicle stereo event camera dataset show that our EAGAN is competitive on the depth estimation task and achieves the state‐of‐the‐art effect in the optical flow estimation task.