Using Neural Networks for Two Dimensional Scientific Data Compression

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations

Abstract

Continual advances in high-performance computing have enabled the development of higher resolution and more realistic simulations of a wide variety of scientific phenomena. As a result, many computational science communities are increasingly constrained by the massive volumes of data produced, for example, strict storage constraints often force reductions in the number of output variables, data output frequency, or simulation length. Accordingly, modelers across many scientific domains are beginning to adopt purpose-built scientific data compression techniques as an effective mitigation for these challenges. The origins of scientific data compression tools every so often lie in image and video compression. Recently, compression researchers have achieved state-of-the-art performance using neural networks for natural image compression, but this achievement has yet to be adapted to scientific data. This paper assesses the performance of an existing autoencoder neural network compression algorithm on two sets of two-dimensional floating-point scientific data. Compared to state-of-the-art scientific data compression algorithms SZ and ZFP, this out-of-the-box neural network achieves higher peak signal-to-noise ratios at low bit rates, and remains competitive in controlling maximum point-wise error. This preliminary assessment paves the way for future research into neural network compression on floating-point scientific data.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE International Conference on Big Data, Big Data 2021
EditorsYixin Chen, Heiko Ludwig, Yicheng Tu, Usama Fayyad, Xingquan Zhu, Xiaohua Tony Hu, Suren Byna, Xiong Liu, Jianping Zhang, Shirui Pan, Vagelis Papalexakis, Jianwu Wang, Alfredo Cuzzocrea, Carlos Ordonez
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2956-2965
Number of pages10
ISBN (Electronic)9781665439022
DOIs
StatePublished - 2021
Event2021 IEEE International Conference on Big Data, Big Data 2021 - Virtual, Online, United States
Duration: Dec 15 2021Dec 18 2021

Publication series

NameProceedings - 2021 IEEE International Conference on Big Data, Big Data 2021

Conference

Conference2021 IEEE International Conference on Big Data, Big Data 2021
Country/TerritoryUnited States
CityVirtual, Online
Period12/15/2112/18/21

Fingerprint

Dive into the research topics of 'Using Neural Networks for Two Dimensional Scientific Data Compression'. Together they form a unique fingerprint.

Cite this