Persistent Identifier Practice for Big Data Management at NCI. (18th April 2017)

• Record Type: Journal Article
• Authors: Wang, Jingbo; Car, Nicholas; Evans, Ben; Gohar, Kashif; Trenham, Claire; Wyborn, Lesley
• Is Part Of: Data science journal. Volume 16(2017)
• Publication Date: 2017-04-18
• Subjects: Persistent Identifier -- Big Data -- URI -- Data catalogue -- Data Management; Science -- Data processing -- Periodicals; Database management -- Periodicals; 502.85
• DOI: 10.5334/dsj-2017-020
• Languages: English
• ISSNs: 1683-1470

Abstract

The National Computational Infrastructure (NCI) manages over 10 PB research data, which is co-located with the high performance computer (Raijin) and an HPC class 3000 core OpenStack cloud system (Tenjin). In support of this integrated High Performance Computing/High Performance Data (HPC/HPD) infrastructure, NCI's data management practices includes building catalogues, DOI minting, data curation, data publishing, and data delivery through a variety of data services. The metadata catalogues, DOIs, THREDDS, and Vocabularies, all use different Uniform Resource Locator (URL) styles. A Persistent IDentifier (PID) service provides an important utility to manage URLs in a consistent, controlled and monitored manner to support the robustness of our national 'Big Data' infrastructure. In this paper we demonstrate NCI's approach of utilising the NCI's PID Service to consistently manage its persistent identifiers with various applications.