EarthCube Data Discovery Studio: A gateway into geoscience data discovery and exploration with Jupyter notebooks. (23rd November 2020)

• Record Type: Journal Article
• Authors: Valentine, David; Zaslavsky, Ilya; Richard, Stephen; Meier, Ouida; Hudman, Gary; Peucker‐Ehrenbrink, Bernhard; Stocks, Karen
• Other Names: Ogiela Marek R. guestEditor.; Rahayu Wenny guestEditor.; Palmieri Francesco guestEditor.; Kalyanam Rajesh guestEditor.; Stankovski Vlado guestEditor.
• Is Part Of: Concurrency and computation. Volume 33:Number 19(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2020-11-23
• Subjects: data discovery -- Jupyter notebooks -- metadata -- metadata augmentation; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.6086
• Languages: English
• ISSNs: 1532-0626

Abstract

Abstract: EarthCube Data Discovery Studio (DDStudio) is a crossdomain geoscience data discovery and exploration portal. It indexes over 1.65 million metadata records harvested from 40+ sources and utilizes a configurable metadata augmentation pipeline to enhance metadata content, using text analytics and an integrated geoscience ontology. Metadata enhancers add keywords with identifiers that map resources to science domains, geospatial features, measured variables, and other characteristics. The pipeline extracts spatial location and temporal references from metadata to generate structured spatial and temporal extents, maintaining provenance of each metadata enhancement, and allowing user validation. The semantically enhanced metadata records are accessible as standard ISO 19115/19139 XML documents via standard search interfaces. A search interface supports spatial, temporal, and text‐based search, as well as functionality for users to contribute, standardize, and update resource descriptions, and to organize search results into shareable collections. DDStudio bridges resource discovery and exploration by letting users launch Jupyter notebooks residing on several platforms for any discovered datasets or dataset collection. DDStudio demonstrates how linking search results from the catalog directly to software tools and environments reduces time to science in a series of examples from several geoscience domains. URL: datadiscoverystudio.org