The presence of automation enhances deontological considerations in moral judgments. (March 2023)

• Record Type: Journal Article
• Authors: Schurr, Amos; Moran, Simone
• Is Part Of: Computers in human behavior. Volume 140(2023)
• Publication Date: 2023-03
• Subjects: Interactive computer systems -- Periodicals; Man-machine systems -- Periodicals; 004.019
• DOI: 10.1016/j.chb.2022.107590
• Languages: English
• ISSNs: 0747-5632

Abstract

Abstract: The rapid deployment of semi-autonomous systems (i.e., systems requiring human monitoring such as Uber AVs) poses ethical challenges when these systems face morally-laden situations. We ask how people evaluate morally-laden decisions of humans who monitor these systems in situations of unavoidable harm. We conducted three pre-registered experiments (total N = 1811), using modified trolley moral dilemma scenarios. Our findings suggest that people apply different criteria when judging morality and deserved punishment of regular-car versus AV drivers. Regular-car drivers are judged according to a consequentialist minimizing harm criterion, whereas AV drivers are judged according to whether or not they took action, with a more favorable prior for acting. Integrating judgment and decision-making research with moral psychology, the current research illuminates how the presence versus absence of automation affects moral judgments. Highlights: The presence of automation increases deontological considerations. Regular-car drivers are judged according to a consequentialist minimizing harm criterion. AV drivers are judged according to whether or not they took action, with a more favorable prior for acting. Taken together, the current research illuminates how the presence vs. absence of automation affects moral judgments.