Development of a Cloud-based Data Match-Up Service (CDMS) in Support of Ocean Science Applications

Nga Chung, Thomas Cram, Shawn R. Smith, Vardis M. Tsontos, Thomas Huang, Kimberly Sparling, Stepheny Perez, Wai Phyo, Zaihua Ji, Riley Kuttruff

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

There is a need in the oceanographic community for a generalized data collocation capability for satellite and/or in situ observations that is publicly accessible and provides flexibility and reproducibility for use cases ranging from open science to satellite retrieval calibration and validation. The Cloud-based Data Match-Up Service (CDMS) is a collaborative effort between NASA JPL, COAPS, NCAR, and Saildrone to address this need. With an exponential increase in the volume of satellite data, the CDMS architecture is designed to be scalable and to leverage the elasticity of the cloud. The differences between remote sensing data at various data processing levels and the heterogeneous nature of in situ data makes developing a generic system challenging, but CDMS is designed with the consideration of making it possible to efficiently onboard new datasets. This paper describes the architecture and technologies behind CDMS and provides details on how the data match-up implementation is validated.

Original languageEnglish
Title of host publicationOCEANS 2022 Hampton Roads
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665468091
DOIs
StatePublished - 2022
Event2022 OCEANS Hampton Roads, OCEANS 2022 - Hampton Roads, United States
Duration: Oct 17 2022Oct 20 2022

Publication series

NameOceans Conference Record (IEEE)
Volume2022-October
ISSN (Print)0197-7385

Conference

Conference2022 OCEANS Hampton Roads, OCEANS 2022
Country/TerritoryUnited States
CityHampton Roads
Period10/17/2210/20/22

Keywords

  • big data
  • cloud
  • collocation
  • data match-up
  • in situ
  • oceanography
  • parallel compute
  • remote sensing
  • satellite

Fingerprint

Dive into the research topics of 'Development of a Cloud-based Data Match-Up Service (CDMS) in Support of Ocean Science Applications'. Together they form a unique fingerprint.

Cite this