Burning Sage: Reversing the Curse of Dimensionality in the Visualization of High-Dimensional Data. Issue 1 (2nd January 2022)

• Record Type: Journal Article
• Authors: Laa, Ursula; Cook, Dianne; Lee, Stuart
• Is Part Of: Journal of computational and graphical statistics. Volume 31:Issue 1(2022)
• Page Start: 40
• Page End: 49
• Publication Date: 2022-01-02
• Subjects: Dynamic graphics -- Data science -- Data visualization -- Grand tour -- Machine learning -- Multivariate data -- Statistical computing -- Statistical graphics; Mathematical statistics -- Data processing -- Periodicals; Mathematical statistics -- Graphic methods -- Periodicals; 519.50285
• DOI: 10.1080/10618600.2021.1963264
• Languages: English
• ISSNs: 1061-8600

Abstract

Abstract: In high-dimensional data analysis, the curse of dimensionality reasons that points tend to be far away from the center of the distribution and on the edge of high-dimensional space. Contrary to this, is that projected data tends to clump at the center. This gives a sense that any structure near the center of the projection is obscured, whether this is true or not. A geometric transformation to reverse the curse, is defined in this article, which uses radial transformations on the projected data. It is integrated seamlessly into the grand tour algorithm, and we have called it a burning sage tour, to indicate that it reverses the curse. The work is implemented into the tourr package in R. Several case studies are included that show how the sage visualizations enhance exploratory clustering and classification problems. Supplementary files for this article are available online.