Human confidence in artificial intelligence and in themselves: The evolution and impact of confidence on adoption of AI advice. (February 2022)

• Record Type: Journal Article
• Authors: Chong, Leah; Zhang, Guanglu; Goucher-Lambert, Kosa; Kotovsky, Kenneth; Cagan, Jonathan
• Is Part Of: Computers in human behavior. Volume 127(2022)
• Publication Date: 2022-02
• Subjects: Artificial intelligence -- Human-AI interaction -- Decision-making -- Confidence -- Trust; Interactive computer systems -- Periodicals; Man-machine systems -- Periodicals; 004.019
• DOI: 10.1016/j.chb.2021.107018
• Languages: English
• ISSNs: 0747-5632

Abstract

Abstract: Artificial intelligence (AI) has shown its promise in assisting human decision-making. However, humans' inappropriate decision to accept or reject suggestions from AI can lead to severe consequences in high-stakes AI-assisted decision-making scenarios. This problem persists due to insufficient understanding of human trust in AI. Therefore, this research studies how two types of human confidence that affect trust, their confidence in AI and confidence in themselves, evolve and affect humans' decisions. A cognitive study and a quantitative model together examine how changing positive and negative experiences affect these confidences and ultimate decisions. Results show that human self-confidence, not their confidence in AI, directs the decision to accept or reject AI suggestions. Furthermore, this work finds that humans often misattribute blame to themselves and enter a vicious cycle of relying on a poorly performing AI. Findings reveal the need and provide insights to effectively calibrate human self-confidence for successful AI-assisted decision-making. Highlights: Human self-confidence directs the decisions to adopt AI suggestions. Misattribution of blame leads humans to rely on a poorly performing AI. Individual experiences during AI-assisted decision-making affect human confidence. A model of human confidence informs how human-AI interaction influences confidence.