Big and high dimensional data in the digital world: statistical, computational and privacy challenges. (2016)

• Record Type: Journal Article
• Authors: Ramanathan, Vanisree; Bangali, Swapnil Sudhir
• Is Part Of: International journal of automation and logistics. Volume 2:Number 4(2016)
• Page Start: 369
• Page End: 387
• Publication Date: 2016
• Subjects: big data analytics -- high dimensional data -- legal challenges -- privacy challenges -- statistical challenges -- computational challenges; Automation -- Periodicals; Logistics -- Periodicals; Logistics -- Computer programs -- Periodicals; 658.514
• Languages: English
• ISSNs: 2049-6745

Abstract

Big data holds great promises and opportunities for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. Huge size and high dimensionality of big data introduce various statistical, computational, legal and privacy challenges. These challenges are distinguished and formidable, and require new statistical, computational and legal paradigm. In this paper, we present a brief non-technical overview of the salient features of big and high dimensional data; explain how these features impact on paradigm changes on statistical, computational and legal aspects. The paper ends with some concluding remarks about these new challenges and future research directions.