TY - JOUR
T1 - Quality Control of Geostationary Lightning Mapper Observations for Tropical Cyclone Applications
AU - Trabing, Benjamin C.
AU - Hilburn, K.
AU - Stevenson, S.
AU - Musgrave, K. D.
AU - Demaria, M.
N1 - Publisher Copyright:
© 2024 American Meteorological Society.
PY - 2024/9/1
Y1 - 2024/9/1
N2 - The Geostationary Lightning Mapper (GLM) has been providing unprecedented observations of total lightning since becoming operational in 2017. The potential for GLM observations to be used for forecasting and analyzing tropical cyclone (TC) structure and intensity has been complicated by inconsistencies in the GLM data from a number of artifacts. The algorithm that processes raw GLM data has improved with time; however, the need for a consistent longterm dataset has motivated the development of quality control (QC) techniques to help remove clear artifacts such as blooming events, spurious false lightning, “bar” effects, and sun glint. Simple QC methods are applied that include scaled maximum energy thresholds and minima in the variance of lightning group area and group energy. QC and anomaly detection methods based on machine learning (ML) are also explored. Each QC method is successfully able to remove artifacts in the GLM observations while maintaining the fidelity of the GLM observations within TCs. As the GLM processing algorithm has improved with time, the amount of QC flagged lightning within 100 km of Atlantic TCs is reduced, from 70% during 2017, to 10% in 2018, to 2% during 2021. These QC methods are relevant to the design of ML-based forecasting techniques which could pick up on artifacts rather than the signal of interest in TCs if QC was not applied beforehand.
AB - The Geostationary Lightning Mapper (GLM) has been providing unprecedented observations of total lightning since becoming operational in 2017. The potential for GLM observations to be used for forecasting and analyzing tropical cyclone (TC) structure and intensity has been complicated by inconsistencies in the GLM data from a number of artifacts. The algorithm that processes raw GLM data has improved with time; however, the need for a consistent longterm dataset has motivated the development of quality control (QC) techniques to help remove clear artifacts such as blooming events, spurious false lightning, “bar” effects, and sun glint. Simple QC methods are applied that include scaled maximum energy thresholds and minima in the variance of lightning group area and group energy. QC and anomaly detection methods based on machine learning (ML) are also explored. Each QC method is successfully able to remove artifacts in the GLM observations while maintaining the fidelity of the GLM observations within TCs. As the GLM processing algorithm has improved with time, the amount of QC flagged lightning within 100 km of Atlantic TCs is reduced, from 70% during 2017, to 10% in 2018, to 2% during 2021. These QC methods are relevant to the design of ML-based forecasting techniques which could pick up on artifacts rather than the signal of interest in TCs if QC was not applied beforehand.
KW - Artificial intelligence
KW - Data quality control
KW - Lightning
KW - Neural networks
KW - Tropical cyclones
UR - https://www.scopus.com/pages/publications/85207518389
U2 - 10.1175/JTECH-D-23-0138.1
DO - 10.1175/JTECH-D-23-0138.1
M3 - Article
AN - SCOPUS:85207518389
SN - 0739-0572
VL - 41
SP - 889
EP - 901
JO - Journal of Atmospheric and Oceanic Technology
JF - Journal of Atmospheric and Oceanic Technology
IS - 9
ER -