Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3583780.3615069acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

STAMINA (Spatial-Temporal Aligned Meteorological INformation Attention) and FPL (Focal Precip Loss): Advancements in Precipitation Nowcasting for Heavy Rainfall Events

Published: 21 October 2023 Publication History

Abstract

Precipitation nowcasting is crucial for weather-dependent decision-making in various sectors, providing accurate and high-resolution predictions of precipitation within a typical two-hour timeframe. Deep learning techniques have shown promise in improving nowcasting accuracy by leveraging large radar datasets. However, accurately predicting heavy rainfall events remains challenging due to several persistent problems in previous work. These include spatial-temporal misalignment between meteorological information and precipitation data, as well as the performance gap between different rainfall levels. To address these challenges, we propose two innovative modules: Spatial-Temporal Aligned Meteorological INformation Attention (STAMINA) and Focal Precip Loss (FPL). STAMINA integrates meteorological information using spatial-temporal embedding and pixelwise linear attention mechanisms to overcome spatial-temporal misalignment. FPL addresses event imbalance through event weighting and a penalty mechanism. Through extensive experiments, we demonstrate significant performance improvements achieved by STAMINA and FPL, with an 8% improvement in predicting light rainfall and, more significantly, a 30% improvement in heavy rainfall compared to the state-of-the-art DGMR model. These modules offer practical and effective solutions for enhancing nowcasting accuracy, with a specific focus on improving predictions for heavy rainfall events. By tackling the persistent problems in previous work, our proposed approach represents a significant advancement in the field of precipitation nowcasting.

References

[1]
Shreya Agrawal, Luke Barrington, Carla Bromberg, John Burge, Cenk Gazen, and Jason Hickey. 2019. Machine learning for precipitation nowcasting from radar images. arXiv preprint arXiv:1912.12132 (2019).
[2]
Georgy Ayzel, Tobias Scheffer, and Maik Heistermann. 2020. RainNet v1. 0: a convolutional neural network for radar-based precipitation nowcasting. Geoscientific Model Development, Vol. 13, 6 (2020), 2631--2644.
[3]
Cong Bai, Feng Sun, Jinglin Zhang, Yi Song, and Shengyong Chen. 2022. Rainformer: Features extraction balanced network for radar-based precipitation nowcasting. IEEE Geoscience and Remote Sensing Letters, Vol. 19 (2022), 1--5.
[4]
Joan Bech and Jorge Luis Chau. 2012. Doppler radar observations: Weather radar, wind profiler, ionospheric radar, and other advanced applications. BoD--Books on Demand.
[5]
Stanley G Benjamin, Stephen S Weygandt, John M Brown, Ming Hu, Curtis R Alexander, Tatiana G Smirnova, Joseph B Olson, Eric P James, David C Dowell, Georg A Grell, et al. 2016. A North American hourly assimilation and model forecast cycle: The Rapid Refresh. Monthly Weather Review, Vol. 144, 4 (2016), 1669--1694.
[6]
Mark Buehner and Dominik Jacques. 2020. Non-Gaussian deterministic assimilation of radar-derived precipitation accumulations. Monthly Weather Review, Vol. 148, 2 (2020), 783--808.
[7]
Lasse Espeholt, Shreya Agrawal, Casper Sønderby, Manoj Kumar, Jonathan Heek, Carla Bromberg, Cenk Gazen, Rob Carver, Marcin Andrychowicz, Jason Hickey, et al. 2022. Deep learning for twelve hour precipitation forecasts. Nature communications, Vol. 13, 1 (2022), 5145.
[8]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM, Vol. 63, 11 (2020), 139--144.
[9]
Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, and Francc ois Fleuret. 2020. Transformers are rnns: Fast autoregressive transformers with linear attention. In International Conference on Machine Learning. PMLR, 5156--5165.
[10]
Vadim Lebedev, Vladimir Ivashkin, Irina Rudenko, Alexander Ganshin, Alexander Molchanov, Sergey Ovcharenko, Ruslan Grokhovetskiy, Ivan Bushmarinov, and Dmitry Solomentsev. 2019. Precipitation nowcasting with satellite imagery. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 2680--2688.
[11]
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. 2017. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision. 2980--2988.
[12]
Zhifeng Ma, Hao Zhang, and Jie Liu. 2022. Focal Frame Loss: A Simple but Effective Loss for Precipitation Nowcasting. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 15 (2022), 6781--6788.
[13]
MRMS. 2023. Multi-radar/multi-sensor system (mrms). https://www.nssl.noaa.gov/projects/mrms/
[14]
Zobeir Raisi, Mohamed A Naiel, Paul Fieguth, Steven Wardell, and John Zelek. 2020. 2D positional embedding-based transformer for scene text recognition. Journal of Computational Vision and Imaging Systems, Vol. 6, 1 (2020), 1--4.
[15]
Suman Ravuri, Karel Lenc, Matthew Willson, Dmitry Kangin, Remi Lam, Piotr Mirowski, Megan Fitzsimons, Maria Athanassiadou, Sheleem Kashem, Sam Madge, et al. 2021. Skilful precipitation nowcasting using deep generative models of radar. Nature, Vol. 597, 7878 (2021), 672--677.
[16]
Franziska Schmid, Yong Wang, and Abdoulaye Harou. 2019. Nowcasting guidelines--a summary. Bulletin, Vol. 68 (2019), 2.
[17]
Xingjian Shi, Zhihan Gao, Leonard Lausen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, and Wang-chun Woo. 2017. Deep learning for precipitation nowcasting: A benchmark and a new model. Advances in neural information processing systems, Vol. 30 (2017).
[18]
Casper Kaae Sønderby, Lasse Espeholt, Jonathan Heek, Mostafa Dehghani, Avital Oliver, Tim Salimans, Shreya Agrawal, Jason Hickey, and Nal Kalchbrenner. 2020. Metnet: A neural weather model for precipitation forecasting. arXiv preprint arXiv:2003.12140 (2020).
[19]
Juanzhen Sun. 2005. Convective-scale assimilation of radar data: progress and challenges. Quarterly Journal of the Royal Meteorological Society: A journal of the atmospheric sciences, applied meteorology and physical oceanography, Vol. 131, 613 (2005), 3439--3463.
[20]
Zoltan Toth and Eugenia Kalnay. 1997. Ensemble forecasting at NCEP and the breeding method. Monthly Weather Review, Vol. 125, 12 (1997), 3297--3319.
[21]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017).
[22]
Yunbo Wang, Zhifeng Gao, Mingsheng Long, Jianmin Wang, and S Yu Philip. 2018. Predrnn: Towards a resolution of the deep-in-time dilemma in spatiotemporal predictive learning. In International Conference on Machine Learning. PMLR, 5123--5132.
[23]
Yunbo Wang, Jianjin Zhang, Hongyu Zhu, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2019. Memory in memory: A predictive neural network for learning higher-order non-stationarity from spatiotemporal dynamics. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 9154--9162.
[24]
James W Wilson, Yerong Feng, Min Chen, and Rita D Roberts. 2010. Nowcasting challenges during the Beijing Olympics: Successes, failures, and implications for future nowcasting systems. Weather and Forecasting, Vol. 25, 6 (2010), 1691--1714.

Index Terms

  1. STAMINA (Spatial-Temporal Aligned Meteorological INformation Attention) and FPL (Focal Precip Loss): Advancements in Precipitation Nowcasting for Heavy Rainfall Events

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
        October 2023
        5508 pages
        ISBN:9798400701245
        DOI:10.1145/3583780
        Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 21 October 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. data imbalanced
        2. focal loss
        3. neural networks
        4. precipitation nowcasting
        5. spatial temporal

        Qualifiers

        • Research-article

        Funding Sources

        • National Science and Technology Council

        Conference

        CIKM '23
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

        Upcoming Conference

        CIKM '25

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 154
          Total Downloads
        • Downloads (Last 12 months)92
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 21 Jan 2025

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media