How do people use information presentation to make decisions in Bayesian reasoning tasks?. Issue 111 (March 2018)

• Record Type: Journal Article
• Authors: Reani, Manuele; Davies, Alan; Peek, Niels; Jay, Caroline
• Is Part Of: International journal of human-computer studies. Issue 111(2018)
• Page Start: 62
• Page End: 77
• Publication Date: 2018-03
• Subjects: Information visualisation -- Bayesian reasoning -- Probabilistic reasoning -- Data visualisation -- Judgment -- Decision making -- Visual Analytics -- Eye-tracking -- Usability testing -- User experience; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2017.11.004
• Languages: English
• ISSNs: 1071-5819

Abstract

Highlights: A comprehensive study investigating the role of information visualization in Bayesian reasoning using eye-tracking. The format in which the information is presented does not affect participants' ability to provide a correct answer. A new metric of performance was developed which provided a deeper understanding of the reasoning process. The rarity of events affects reasoning. The magnitude of the error generated when estimating the correct value is related to informationbase rate. Participants did not like legends; for complex problems involving relationships between variables legends may be detrimental. Abstract: Humans often struggle to understand conditional probability, which underlies the interpretation of many important procedures including medical tests. Visualisation has proved effective in communicating risk in healthcare settings, but its role in facilitating Bayesian reasoning is complex, with contradictory evidence as to its utility, and a lack of understanding as to how it is best applied. This paper evaluates both established and novel techniques for visualising conditional probabilities, examining not just whether they facilitate understanding, but how people use the way the information is presented to interpret the data. We report a controlled study comparing different visualisations of a well-known Bayesian problem, the mammography problem, to its textual description. We use eye tracking, coupled with a novel technique to measure the reasoning process (which we term the utilisation metric ), alongside measures of efficiency, effectiveness and satisfaction, to reveal cognitive processes underpinning human-graph understanding. The results demonstrate that the rarity of an event strongly affects how far someone's estimation deviates from the true value of the risk, with rare events resulting in a larger deviation than common events. The results also show that the way in which the data is presented affects both speed and accuracy of interpretation, and that people have preferences that cannot be explained by performance data alone. Whilst Venn diagrams appear to be equal to tree diagrams in terms of task performance, people find the latter easier to interpret. Icon arrays, which are commonly used for presenting risk data, are perceived to be particularly poor at conveying information about conditional probabilities.