Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design. Issue 161 (May 2022)

• Record Type: Journal Article
• Authors: Haugeland, Isabel Kathleen Fornell; Følstad, Asbjørn; Taylor, Cameron; Bjørkli, Cato Alexander
• Is Part Of: International journal of human-computer studies. Issue 161(2022)
• Publication Date: 2022-05
• Subjects: Chatbots -- Customer service -- Interaction design -- User experience -- Human likeness -- Social presence; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2022.102788
• Languages: English
• ISSNs: 1071-5819

Abstract

Highlights: User experience is impacted by interaction style and conversation types in customer service chatbots. Conversations that explore a topic of interest may strengthen perceived anthropomorphism and hedonic user experience compared to conversations aimed towards a narrow goal. Button interaction may strengthen pragmatic and hedonic user experience compared to free text interaction, but not impact perceived anthropomorphism. Conversation type may impact the perceived anthropomorphism in chatbots without impacting social presence. Abstract: Understanding the user experience of chatbots for customer service is essential to realize the potential of this technology. Such chatbots are typically designed for efficient and effective interactions, accentuating pragmatic quality, and there is a need to understand how to make these more pleasant and engaging, strengthening hedonic quality . One promising approach is to design for more humanlike chatbot interactions, that is, interactions resembling those of skilled customer service personnel. In a randomized experiment (n = 35) we investigated two chatbot interaction design features that may strengthen the impression of a humanlike character: (a) topic-led conversations, encouraging customer reflection, in contrast to task-led conversations, aiming for efficient goal completion, and (b) free text interaction, where users interact mainly using their own words, rather than button interaction, where users mainly interact through predefined answer alternatives. dependent variables were participant perceptions of anthropomorphism and social presence, two key concepts related to chatbot human likeness, in addition to pragmatic quality and hedonic quality. To further explore user perceptions of the interaction designs, the study also included semi-structured interviews. Topic-led conversations were found to strengthen anthropomorphism and hedonic quality. A similar effect was not found for free text interaction, reportedly due to lack in chatbot flexibility and adaptivity. Implications for theory and practice are suggested.