Information, uncertainty and the manipulability of artificial intelligence autonomous vehicles systems. Issue 130 (October 2019)

• Record Type: Journal Article
• Authors: Osório, António; Pinto, Alberto
• Is Part Of: International journal of human-computer studies. Issue 130(2019)
• Page Start: 40
• Page End: 46
• Publication Date: 2019-10
• Subjects: Artificial intelligence -- Autonomous vehicles -- Manipulation -- Malicious behavior -- Uncertainty; D81 -- L62 -- O32; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2019.05.003
• Languages: English
• ISSNs: 1071-5819

Abstract

Highlights: AV utilitarian protocols implies some predictability. If AV decision process is perfectly known then is manipulable. Sufficiently high levels of uncertainty are necessary. Uncertainty decreases the risk of successful manipulation. (but) Uncertainty decrease the quality of the decision process, efficiency and welfare. Abstract: In an avoidable harmful situation, autonomous vehicles systems are expected to choose the course of action that causes the less damage to everybody. However, this behavioral protocol implies some predictability. In this context, we show that if the autonomous vehicle decision process is perfectly known then malicious, opportunistic, terrorist, criminal and non-civic individuals may have incentives to manipulate it. Consequently, some levels of uncertainty are necessary for the system to be manipulation proof. Uncertainty removes the misbehavior incentives because it increases the risk and likelihood of unsuccessful manipulation. However, uncertainty may also decrease the quality of the decision process with negative impact in terms of efficiency and welfare for the society. We also discuss other possible solutions to this problem.