Advanced optical methods for safe image reproduction on automotive displays. Issue 1 (14th September 2021)

• Record Type: Journal Article
• Authors: Blankenbach, Karlheinz; Vogelmann, Matthaeus; Schmitz, Norbert
• Is Part Of: Journal of the Society for Information Display. Volume 30:Issue 1(2022)
• Page Start: 33
• Page End: 53
• Publication Date: 2021-09-14
• Subjects: artificial intelligence -- automotive displays -- camera monitor systems -- functional safety -- machine learning -- object recognition -- optical measurement; Information display systems -- Periodicals; 621.38154205
• DOI: 10.1002/jsid.1079
• Languages: English
• ISSNs: 1071-0922

Abstract

Abstract: Modern cars are equipped with camera monitor systems (CMSs), such as a backup camera or side‐mirror replacement. These systems are expected to perform optimally and achieve high safety levels (ASIL). Currently, only digital data are supervised in CMSs and safety mechanisms for such systems are individually derived on a case‐by‐case basis which is not effective. This study proposes generic optical supervision for displays of automotive CMS. This paper introduces "light‐to‐light" (camera to display output) protection for both in‐car CMS and remote operator monitors used in autonomous car fleet operation centers. The first method is based on photodiodes attached to the display to optically supervise, for instance, the speedometer of vehicles. By combining intensities of photodiodes with calibration data, we can compare the measured speed with the value from CAN (Controller Area Network) data. The second method that entails capturing the display content using a camera enables top safety levels for both in‐car displays and remote operator monitors. This safeguarding was successfully verified by conventional image processing and artificial intelligence (AI)‐based analysis methods. Our results demonstrate that AI methods allow a substantial reduction in the wireless transmission bandwidth from a car to a remote operator compared with conventional image processing. Abstract : Automotive Camera Monitor Systems should fulfil highest safety levels but today only digital data are supervised. We introduce "light‐to‐light" safeguarding by optical supervision of the display. Three different methods have been successfully evaluated: Photodiodes mounted to the display and a camera to capture the display content. Both image processing and artificial intelligence perform the analysis for the latter.