A User Evaluation Study: Do Participants' Personal Notes Help Us to Summarise Meetings?. (April 2014)

• Record Type: Journal Article
• Authors: Bothin, Antje; Clough, Paul
• Is Part Of: Knowledge and process management. Volume 21:Number 2(2014:Apr./Jun.)
• Page Start: 122
• Page End: 133
• Publication Date: 2014-04
• Subjects: Organizational change -- Periodicals; Industrial management -- Periodicals; Corporate reorganizations -- Periodicals; Production management -- Periodicals; 658.406
• DOI: 10.1002/kpm.1439
• Languages: English
• ISSNs: 1092-4604

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <p>We describe a novel user evaluation study on the value of people's personal meeting notes for a question‐answering task involving meeting data taken from the Augmented Multiparty Interaction (AMI) corpus. A survey on task perceptions and note‐taking strategies in meetings was also conducted. The results suggest that written notes taken by multiple meeting participants contain the majority of the most informative meeting information and are thus likely to support information systems that employ automatic meeting understanding and summarisation. The users were able to achieve 79% and 76% accuracy in the task with handwritten and typed notes respectively as information source. Contrary to that, they scored 36% accuracy only using short extracts from the meeting speech and 98% correctness using abstractive human model summaries. The survey showed that people are generally very experienced with attending meetings and note‐taking and usually record the most important meeting events in a concise way. This provides evidence for the fact that personal notes are suitable as keywords and indices into a meeting recording. In general, task results correlated positively with perceived success. Users liked well‐structured abstractive human reference summaries but found meeting speech extracts difficult to work with. However, they also disliked the appearance of the notes, in particular the fact that the handwritten ones were hard to read. This emphasises the need for the development of innovative handwriting recognition methods and user interfaces that employ new presentation techniques, for example, key area highlighting. Meeting participants would also benefit from corporate training for better communication and note‐taking skills. Copyright © 2014 John Wiley & Sons, Ltd.</p> </abstract>