A principlist-based study of the ethical design and acceptability of artificial social agents. Issue 172 (April 2023)

• Record Type: Journal Article
• Authors: Richards, Deborah; Vythilingam, Ravi; Formosa, Paul
• Is Part Of: International journal of human-computer studies. Issue 172(2023)
• Publication Date: 2023-04
• Subjects: Artificial social agents -- Ethical acceptability -- Intelligent virtual agents -- Social robots -- AI4People ethical principles -- Schwartz' human values; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2022.102980
• Languages: English
• ISSNs: 1071-5819

Abstract

Highlights: Studies focused on ethical acceptability of Artificial Social Agents (ASAs) are lacking. Four ASA scenarios are embedded with the five AI4People ethical principles. Autonomy and justice raise concerns for ASAs' decision-making and persuasive behaviours. Explicability raises concerns for ASAs' deceptive use of false memories and emotions. Values of 268 participants are connected with the prioritization of the five ethical principles. Abstract: Artificial Social Agents (ASAs), which are AI software driven entities programmed with rules and preferences to act autonomously and socially with humans, are increasingly playing roles in society. As their sophistication grows, humans will share greater amounts of personal information, thoughts, and feelings with ASAs, which has significant ethical implications. We conducted a study to investigate what ethical principles are of relative importance when people engage with ASAs and whether there is a relationship between people's values and the ethical principles they prioritise. The study uses scenarios, embedded with the five AI4People ethical principles (Beneficence, Non-maleficence, Autonomy, Justice, and Explicability), involving ASAs taking on roles traditionally played by humans to understand whether these roles and behaviours (including dialogues) are seen as acceptable or unacceptable. Results from 268 participants reveal the greatest sensitivity to ASA behaviours that relate to Autonomy, Justice, Explicability, and the privacy of their personal data. Models were created using Schwartz's Refined Values as a possible indicator of how stakeholders discern and prioritise the different AI4People ethical principles when interacting with ASAs. Our findings raise issues around the ethical acceptability of ASAs for nudging and changing behaviour due to participants' desire for autonomy and their concerns over deceptive ASA behaviours such as pretending to have memories and emotions.