Developing an Open Data Portal for the ESA Climate Change Initiative. (6th April 2020)
- Record Type:
- Journal Article
- Title:
- Developing an Open Data Portal for the ESA Climate Change Initiative. (6th April 2020)
- Main Title:
- Developing an Open Data Portal for the ESA Climate Change Initiative
- Authors:
- Kershaw, Philip
Halsall, Kevin
Lawrence, Bryan N.
Bennett, Victoria
Donegan, Steve
Iwi, Alan
Juckes, Martin
Pechorro, Eduardo
Petrie, Ruth
Singleton, Joe
Stephens, Ag
Waterfall, Alison
Wilson, Antony
Wood, Alexander - Abstract:
- We introduce the rationale for, and architecture of, the European Space Agency Climate Change Initiative (CCI) Open Data Portal (http://cci.esa.int/data/ ). The Open Data Portal hosts a set of richly diverse datasets – 13 "Essential Climate Variables" – from the CCI programme in a consistent and harmonised form and to provides a single point of access for the (>100 TB) data for broad dissemination to an international user community. These data have been produced by a range of different institutions and vary across both scientific and spatio-temporal characteristics. This heterogeneity of the data together with the range of services to be supported presented significant technical challenges. An iterative development methodology was key to tackling these challenges: the system developed exploits a workflow which takes data that conforms to the CCI data specification, ingests it into a managed archive and uses both manual and automatically generated metadata to support data discovery, browse, and delivery services. It utilises both Earth System Grid Federation (ESGF) data nodes and the Open Geospatial Consortium Catalogue Service for the Web (OGC-CSW) interface, serving data into both the ESGF and the Global Earth Observation System of Systems (GEOSS). A key part of the system is a new vocabulary server, populated with CCI specific terms and relationships which integrates OGC-CSW and ESGF search services together, developed as part of a dialogue between domain scientists andWe introduce the rationale for, and architecture of, the European Space Agency Climate Change Initiative (CCI) Open Data Portal (http://cci.esa.int/data/ ). The Open Data Portal hosts a set of richly diverse datasets – 13 "Essential Climate Variables" – from the CCI programme in a consistent and harmonised form and to provides a single point of access for the (>100 TB) data for broad dissemination to an international user community. These data have been produced by a range of different institutions and vary across both scientific and spatio-temporal characteristics. This heterogeneity of the data together with the range of services to be supported presented significant technical challenges. An iterative development methodology was key to tackling these challenges: the system developed exploits a workflow which takes data that conforms to the CCI data specification, ingests it into a managed archive and uses both manual and automatically generated metadata to support data discovery, browse, and delivery services. It utilises both Earth System Grid Federation (ESGF) data nodes and the Open Geospatial Consortium Catalogue Service for the Web (OGC-CSW) interface, serving data into both the ESGF and the Global Earth Observation System of Systems (GEOSS). A key part of the system is a new vocabulary server, populated with CCI specific terms and relationships which integrates OGC-CSW and ESGF search services together, developed as part of a dialogue between domain scientists and linked data specialists. These services have enabled the development of a unified user interface for graphical search and visualisation – the CCI Open Data Portal Web Presence. … (more)
- Is Part Of:
- Data science journal. Volume 19(2020)
- Journal:
- Data science journal
- Issue:
- Volume 19(2020)
- Issue Display:
- Volume 19, Issue 2020 (2020)
- Year:
- 2020
- Volume:
- 19
- Issue:
- 2020
- Issue Sort Value:
- 2020-0019-2020-0000
- Page Start:
- Page End:
- Publication Date:
- 2020-04-06
- Subjects:
- Essential Climate Variables -- Controlled Vocabularies -- Linked Data -- CF-NetCDF -- OPeNDAP -- OGC Services
Science -- Data processing -- Periodicals
Database management -- Periodicals
502.85 - Journal URLs:
- http://datascience.codata.org/ ↗
http://www.codata.org/dsj/index.html ↗ - DOI:
- 10.5334/dsj-2020-016 ↗
- Languages:
- English
- ISSNs:
- 1683-1470
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library HMNTS - ELD Digital store
- Ingest File:
- 15598.xml