Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Monitoring of volcanic ash cloud from heterogeneous data using feature fusion and convolutional neural networks–long short-term memory

  • S.I. : DPTA Conference 2019
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Heterogeneous data have become a key issue restricting the monitoring accuracy of volcanic ash cloud and rapid application of remote sensing. In view of the characteristics of classification and heterogeneous data in volcanic ash cloud monitoring, a monitoring method of volcanic ash cloud using feature fusion, convolutional neural networks (CNN) and long short-term memory (LSTM) (FF–CNN–LSTM) is presented in this paper. In this method, firstly, the target features in image are identified by CNN and the time sequence information in text is extracted by LSTM. Secondly, the mapping relationship between text information and image features is learned by fusing image target and text high-level features, and then the identification and diffusion of volcanic ash cloud from heterogeneous data containing only image and text were performed. Finally, the presented FF–CNN–LSTM method is tested by the simulation experiment and the true heterogeneous data of Enta volcanic ash cloud case. The experimental results show that compared with the single CNN, LSTM and the simple combination between CNN and LSTM (CNN–LSTM), the presented FF–CNN–LSTM method in this paper can be fitted with less training steps and has high accuracy and low loss rate; the obtained distribution of volcanic ash cloud is clear and intuitive and has the characteristics with fewer model parameters, simple calculation and high accuracy. It also shows the feasibility and effectiveness of the presented method in volcanic ash cloud monitoring to some extent. The results reveal that the presented method can potentially contribute the monitoring of volcanic ash cloud and disaster prevention and mitigation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Ganci G, Gappello A, Bilotta G, Negro C (2020) How the variety of satellite remote sensing data over volcanoes can assist hazard monitoring efforts: the 2011 eruption of nabro volcano. Remote Sens Environ 236:111426

    Article  Google Scholar 

  2. Tupper A, Carn S, Davey J, Kamada Y, Potts R, Prata F, Tokuno M (2004) An evaluation of volcanic ash cloud detection techniques during recent significant eruptions in the eastern ‘ring of fire’. Remote Sens Environ 91(1):27–46

    Article  Google Scholar 

  3. Prata F, Kristianesen N, Thomas HE, Stohi A (2018) Ash metrics for European and trans-atlantic air routes during the Eyjafjallajokull eruption 14 April to 23 May 2010. J Geophys Res Atmos 123(10):5469–5483

    Article  Google Scholar 

  4. Krippner JB, Belousov AB, Belousova MG, Ramsey MS (2018) Parametric analysis of lava dome-collapse events and pyroclastic deposits at Shiveluch volcano, Kamchatka, using visible and infrared satellite data. J Volcanol Geoth Res 354(1):115–129

    Article  Google Scholar 

  5. Gomez-Letona M, Aristegui J, Ramos AG, Montero MF, Coca J (2018) Lack of impact of the El Hierro (Canary Islands) submarine volcanic eruption on the local phytoplankton community. Sci Rep-UK 8(1):4667

    Article  Google Scholar 

  6. Marzano FS, Corradini S, Mereu L, Kylling A, Montopoli A, Cimini D, Merucci L, Stelitano D (2018) Multisatellite multisensory observations of a sub-plinian volcanic eruption: the 2015 Calbuco explosive event on Chile. IEEE T Geosci Remote 56(5):2597–2612

    Article  Google Scholar 

  7. Mccarthy EB, Bluth GJS, Watson IM, Tupper A (2008) Detection and analysis of the volcanic ash clouds associated with the 18 and 28 August 2000 eruptions of Miyakejima volcano. Japan Int J Remote Sens 29(22):6597–6620

    Article  Google Scholar 

  8. Ellrod GP (2004) Impact on volcanic ash detection caused by the loss of the 12.0 μm “split window” band on GIES imagers. J Volcanol Geoth Res 135(1–2):91–103

    Article  Google Scholar 

  9. Lee SH, Choi YS, Lee R, Park GS, Hong EK (2018) A decision support system for scientists by processing large-scale satellite images on a distributed computing environment. Multimed Tools App 77(11):14305–14326

    Article  Google Scholar 

  10. Wei YM, Quan JC, Hou YQY (2017) UAV sequential localization based on CNN and Bi-LSTM. Electron Optics Control 24(12):51–55

    Google Scholar 

  11. Cui XL, Chen LF, Xing XM, Yuan ZH (2019) Remote sensing image scene classification based on frequency band feature fusion and GL-CNN. Remote Sens Technol App 34(4):712–719

    Google Scholar 

  12. Huang HS, Lan YB, Yang AP, Zhang YL, Wen S, Deng JZ (2020) Deep learning versus object-based image analysis (OBIA) in weed mapping of UVA imagery. Int J Remote Sens 41(9):3446–3479

    Article  Google Scholar 

  13. Wu Y (2020) Research on feature point extraction and machine learning method based on light field imaging. Neural Comput Appl 31(12):8157–8169

    Article  Google Scholar 

  14. Wang YX, Mao H, Yi Z (2019) Stem cell motion-tracking by using deep neural networks with multi-output. Neural Comput Appl 31(8):3455–3467

    Article  Google Scholar 

  15. Flower VJB, Kahn RA (2020) Interpreting the volcanological processes of Kamchatka, based on multi-sensor satellite observations. Remote Sens Environ 237:111585

    Article  Google Scholar 

  16. Westberry TK, Shi YR, Yu H, Behrenfeld MJ, Remer LA (2019) Satellite-detected ocean ecosystem response to volcanic eruptions in the subarctic northeast Pacific Ocean. Geophy Res Lett 46(20):11270–11280

    Article  Google Scholar 

  17. Mossop SC (1964) Volcanic dust collected at an altitude of 20 km. Nature 203(4947):824–827

    Article  Google Scholar 

  18. Krueger AJ (1983) Sighting of El Chichon sulfur dioxide clouds with the nimbus 7 total ozone mapping spectrometer. Science 220(4604):1377–1379

    Article  Google Scholar 

  19. Falconi MT, Marzano FA (2019) Weather radar data processing and atmospheric applications an overview of tools for monitoring clouds and detecting wind shear. IEEE Signal Proc Mag 36(4):85–97

    Article  Google Scholar 

  20. Harper JM, Steffes P, Dufek J, Akins A (2019) The effect of electrostatic charge on the propagation of GPS (L-band) signals through volcanic plumes. J Geophys Res Atmos 124(4):2260–2275

    Article  Google Scholar 

  21. Leadbetter SJ, Hort MC (2011) Volcanic ash hazard climatology for an eruption of Hekla Volcano. Iceland J Volcanol Geoth Res 199(3–4):230–241

    Article  Google Scholar 

  22. Zhao Y, Li YS, Fan QC, Guo ZF (2014) The progress of volcanic ash cloud study in aviation safety. Bull Miner Petrol Geochem 33(4):531–539

    Google Scholar 

  23. Belart JMC, Magnusson E, Berthier E, Palsson F, AdalgeirsdottirJohannesson GT (2019) The geodetic mass balance of Eyjafjallajokull ice cap for 1945–2014: processing guidelines and relation to climate. J Glaciol 65(251):395–409

    Article  Google Scholar 

  24. Prata GS, Ventress LJ, Carboni E, Mather TA, Grainger RG, Pyle DM (2019) A new parameterization of volcanic ash complex refractive index based on NBO/T and SiO2 content. J Geophys Res Atmos 124(3):1779–1797

    Article  Google Scholar 

  25. Woods AW, Self S (1992) Thermal disequilibrium at the top of volcanic clouds and its effect on estimates of the column height. Nature 355(6361):628–630

    Article  Google Scholar 

  26. Stenchikov GL, Kirchner I, Robock A, Graf HF, Antuna JC, Grainger RG, Lambert A, Thomason L (1998) Radiative forcing from the 1991 Mount Pinatubo volcanic eruption. J Geophys Res Atmos 103(D12):13837–13857

    Article  Google Scholar 

  27. Kirchner I, Stenchikov GL, Graf HF, Robock A, Antuna JC (1999) Climate model simulation of winter warming and summer cooling following the 1991 Mount Pinatubo volcanic eruption. J Geophys Res Atmos 104(D16):19039–19055

    Article  Google Scholar 

  28. Daniele P, Lirer L, Petrosino P, Spinelli N, Peterson R (2009) Application of the PUFF model to forecasts of volcanic clouds dispersal from Etna and Vesuvio. Comput Geosci-UK 35(5):1035–1049

    Article  Google Scholar 

  29. Mastin LG, Guffanti M, Servranckx R, Webley P, Barsotti S, Dean K, Durant S, Ewert JW, Neri A, Rose WI, Schneider D, Siebert L, Studer B, Swanson G, Tupper A, Volentik A, Waythomas CF (2009) A multidisciplinary effort to assign realistic source parameters to models of volcanic ash-cloud transport and dispersion during eruption. J Volcanol Geoth Res 186(1):10–21

    Article  Google Scholar 

  30. Durant AJ, Villarosa G, Rose WI, Delmelle P, Prata AJ, Viramonte JG (2012) Long-range volcanic ash transport and fallout during the 2008 eruption of Chaiten volcano. Chile Phys Chem Earth 45–46:50–64

    Article  Google Scholar 

  31. Hinton G, Deng L, Yu D, Dahl GE, Mohamed AR, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN, Kingsbury B (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Proc Mag 29(6):82–97

    Article  Google Scholar 

  32. Arel I (2012) Deep reinforcement learning as foundation for artificial general intelligence. Artif Gen Intell 33(1):89–102

    Google Scholar 

  33. Xu X, He HG (2003) A gradient algorithm for neural-network-based reinforcement learning. Chin J Comput 26(2):227–233

    MathSciNet  Google Scholar 

  34. Zhang X, Zhang DX, Xu LL, Zhang M (2019) Granary storage quantity detection model based on deep neural network. J Nanjing Agr Univ 42(3):559–565

    Google Scholar 

  35. Gai S, Bao ZY (2019) New image denoising algorithm via improved deep convolutional neural network with perceptive loss. Expert Syst Appl 138:112815

    Article  Google Scholar 

  36. Xu G, Zhu X, Tapper N (2019) Using convolutional neural networks incorporating hierarchical active learning for target-searching in large-scale remote sensing images. Int J Remote Sens 41(11):4057–4079

    Article  Google Scholar 

  37. Niu X, Nie GH, Yang D, Yang K, Pan HY, Dou Y, Xia F (2019) Learning ship width and direction by convolutional neural networks without manual labeling. Remote Sens Lett 11(4):323–332

    Article  Google Scholar 

  38. Hei FY, Wang JZ, Zhao LH (2019) Public opinion classification of heterogeneous data based on CNN and LSTM. Comput Syst Appl 28(6):141–147

    Google Scholar 

  39. Liang X, Song C, Hao MR, Zhao JJ, Zheng D (2019) Sequence image visual positioning technology based on LSTM and Siamese network. Mod Def Technol 47(5):65–70

    Google Scholar 

  40. Andronico D, Spinetti C, Cristaldi A, Buongiorno MF (2009) Observations of Mt. Enta volcanic ash plumes in 2006 an integrated approach from ground-based and polar satellite NOAA-AVHRR monitoring system. J Volcanol Geoth Res 180(2–4):135–147

    Article  Google Scholar 

  41. Adetunji OA, Odenivi MA, Itiola OA (2015) Effect of formulation and process variables on the release, mechanical and mucoadhesive properties of ibuprofen tablet formulations. Acta Pol Pharmacetica 72(2):357–365

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Shanghai Foundation for Development of Science and Technology, China (19142201600, 16dz1206000 and 14231202600). The authors gratefully acknowledge these supports.

Author information

Authors and Affiliations

  1. School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai, 201620, China

    Lan Liu & Xian-kun Sun

  2. School of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China

    Cheng-fan Li & Jun-juan Zhao

  3. Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai, 200444, China

    Cheng-fan Li

Authors
  1. Lan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cheng-fan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xian-kun Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun-juan Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cheng-fan Li.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest to this work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, L., Li, Cf., Sun, Xk. et al. Monitoring of volcanic ash cloud from heterogeneous data using feature fusion and convolutional neural networks–long short-term memory. Neural Comput & Applic 33, 667–679 (2021). https://doi.org/10.1007/s00521-020-05050-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05050-y

Keywords

Search

Navigation