Accelerating Scientific Analysis with SciDB. Issue 7 (December 2015)

• Record Type: Journal Article
• Authors: Gerhardt, L.; Faham, C.H.; Yao, Y.
• Is Part Of: Journal of physics. Volume 664:Issue 7(2015)
• Publication Date: 2015-12
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/664/7/072019
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: SciDB is an open-source analytical database for scalable complex analytics on very large array or multi-structured data from a variety of sources, programmable from Python and R. It runs on HPC, commodity hardware grids, or in a cloud and can manage and analyze terabytes of array-structured data and do complex analytics in-database. We present an overall description of the SciDB framework and describe its implementation at NERSC at Lawrence Berkeley National Laboratory. A case study using SciDB to analyze data from the LUX dark matter detector is described and future plans for a large SciDB array at NERSC are described.