Attributions of morality and mind to artificial intelligence after real-world moral violations. (September 2018)

• Record Type: Journal Article
• Authors: Shank, Daniel B.; DeSanti, Alyssa
• Is Part Of: Computers in human behavior. Volume 86(2018)
• Page Start: 401
• Page End: 411
• Publication Date: 2018-09
• Subjects: Artificial intelligence -- Morality -- Responsibility -- Algorithm -- Attributions -- Perceived mind; Interactive computer systems -- Periodicals; Man-machine systems -- Periodicals; 004.019
• DOI: 10.1016/j.chb.2018.05.014
• Languages: English
• ISSNs: 0747-5632

Abstract

Abstract: The media has portrayed certain artificial intelligence (AI) software as committing moral violations such as the AI judge of a human beauty contest being "racist" when it selected predominately light-skinned winners. We examine people's attributions of morality for seven such real-world events that were first publicized in the media, experimentally manipulating the occurrence of a violation and the inclusion of information about the AI's algorithm. Both the presence of the moral violation and the information about the AI's algorithm increase participant's reporting of a moral violation occurring in the event. However, even in the violation outcome conditions only 43.5 percent of the participants reported that they were sure that a moral violation occurred. Addressing whether the AI is blamed for the moral violation we found that people attributed increased wrongness to the AI – but not to the organization, programmer, or users – after a moral violation. In addition to moral wrongness, the AI was attributed moderate levels of awareness, intentionality, justification, and responsibility for the violation outcome. Finally, the inclusion of the algorithm information marginally increased perceptions of the AI having mind, and perceived mind was positively related to attributions of intentionality and wrongness to the AI. Highlights: AI's real-world moral violations only reported 43.5% of the time. Knowledge of algorithm increases moral violation perception. AI not organization, programmer, or use is attributed wrongness. AI attributed mind, awareness, intentionality, justification, and responsibility.