Deep-learning-based precipitation observation quality control

Yingkai Sha, David John Gagne, Gregory West, Roland Stull

Research output: Contribution to journalArticlepeer-review

14 Scopus citations

Abstract

We present a novel approach for the automated quality control (QC) of precipitation for a sparse station observation network within the complex terrain of British Columbia, Canada. Our QC approach uses convolutional neural networks (CNNs) to classify bad observation values, incorporating a multiclassifier ensemble to achieve better QC performance. We train CNNs using human QC’d labels from 2016 to 2017 with gridded precipitation and elevation analyses as inputs. Based on the classification evaluation metrics, our QC approach shows reliable and robust performance across different geographical environments (e.g., coastal and inland mountains), with 0.927 area under curve (AUC) and type I/type II error lower than 15%. Based on the saliency-map-based interpretation studies, we explain the success of CNNbased QC by showing that it can capture the precipitation patterns around, and upstream of the station locations. This automated QC approach is an option for eliminating bad observations for various applications, including the preprocessing of training datasets for machine learning. It can be used in conjunction with human QC to improve upon what could be accomplished with either method alone.

Original languageEnglish
Pages (from-to)1075-1091
Number of pages17
JournalJournal of Atmospheric and Oceanic Technology
Volume38
Issue number5
DOIs
StatePublished - May 2021

Keywords

  • Classification
  • Data quality control
  • Deep learning
  • Machine learning
  • Precipitation

Fingerprint

Dive into the research topics of 'Deep-learning-based precipitation observation quality control'. Together they form a unique fingerprint.

Cite this