Automated email answering by text‐pattern matching: Performance and error analysis. Issue 1 (26th October 2017)

• Record Type: Journal Article
• Authors: Sneiders, Eriks; Sjöbergh, Jonas; Alfalahi, Alyaa
• Other Names: Rocha Álvaro guestEditor.; Lima Stanley guestEditor.
• Is Part Of: Expert systems. Volume 35:Issue 1(2018)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2017-10-26
• Subjects: automated email answering -- email categorization -- question answering -- text patterns; Expert systems (Computer science); 006.33
• DOI: 10.1111/exsy.12251
• Languages: English
• ISSNs: 0266-4720

Abstract

Abstract: Automated answering of frequent email inquiries can be implemented as a text categorization task with narrow text categories, where all messages in 1 text category have the same answer. Such email categorization should be optimized for high precision and at least acceptable recall. One such high‐precision email categorization method is matching of surface text patterns to incoming email messages. In order to assess the upper performance limits of text‐pattern matching, we conducted extensive tests with almost 10, 000 messages. Our results show that automated email answering with precision around 90% and recall 50–75% is feasible. In order to achieve this, however, the system must work with multiword expressions rather than stand‐alone words. Furthermore, we argue that the system has to distinguish the context of an email inquiry from the actual need that created the inquiry—a question, request, or complaint. We have discovered and analysed 12 reasons why text‐pattern matching may fail.