Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

SARDINE: A Self-Adaptive Recurrent Deep Incremental Network Model for Spatio-Temporal Prediction of Remote Sensing Data

Published: 15 April 2020 Publication History

Abstract

The timely and accurate prediction of remote sensing data is of utmost importance especially in a situation where the predicted data is utilized to provide insights into emerging issues, like environmental nowcasting. Significant research progress can be found to date in devising variants of neural network (NN) models to fulfil this requirement by improving feature extraction and dynamic process representation power. Nevertheless, all these existing NN models are built upon rigid structures that often fail to maintain tradeoff between bias and variance, and consequently, need to spend a lot of time to empirically determine the most appropriate network configuration. This article proposes a self-adaptive recurrent deep incremental network model (SARDINE) which is a novel variant of the deep recurrent neural network with intrinsic capability of self-constructing the network structure in a dynamic and incremental fashion while learning from observed data samples. Moreover, the proposed SARDINE is able to model the spatial feature evolution while scanning the data in a single pass manner, and this further saves significant time when dealing with remote sensing imagery containing millions of pixels. Subsequently, we employ SARDINE in combination with a spatial influence mapping unit to accomplish the prediction. The effectiveness of the proposed model is evaluated in terms of predicting a time series of normalized difference vegetation index (NDVI) data derived from Landsat Thematic Mapper (TM)-5 and Moderate Resolution Imaging Spectroradiometer (MODIS) Terra satellite imagery. The experimental result demonstrates that the SARDINE-based prediction is able to achieve state-of-the-art accuracy with significantly reduced computational cost.

References

[1]
Andri Ashfahani and Mahardhika Pratama. 2019. Autonomous deep learning: Continual learning approach for dynamic environments. In Proceedings of the 2019 SIAM International Conference on Data Mining. SIAM, 666--674.
[2]
Bhuvan. 2016. Indian Geo-Platform of ISRO, India. Retrieved December 2016 from http://bhuvan.nrsc.gov.in.
[3]
Jayajit Chakraborty. 2011. Revisiting Tobler’s first law of geography: Spatial regression models for assessing environmental justice and health risk disparities. In Geospatial Analysis of Environmental Health. Springer, 337--356.
[4]
Bin Chen, Bo Huang, Lifan Chen, and Bing Xu. 2017. Spatially and temporally weighted regression: A novel method to produce continuous cloud-free Landsat imagery. IEEE Transactions on Geoscience and Remote Sensing 55, 1 (2017), 27--37.
[5]
Qing Cheng, Huanfeng Shen, Liangpei Zhang, Qiangqiang Yuan, and Chao Zeng. 2014. Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model. ISPRS Journal of Photogrammetry and Remote Sensing 92 (2014), 54--68.
[6]
Hannah M. Cooper, Qi Chen, Charles H. Fletcher, and Matthew M. Barbee. 2013. Assessing vulnerability due to sea-level rise in Maui, Hawai i using LiDAR remote sensing and GIS. Climatic Change 116, 3--4 (2013), 547--563.
[7]
José Luis Crespo, Marta Zorrilla, Pilar Bernardos, and Eduardo Mora. 2007. A new image prediction model based on spatio-temporal techniques. The Visual Computer 23, 6 (2007), 419--431.
[8]
Noel Cressie and Christopher K. Wikle. 2015. Statistics for Spatio-temporal Data. John Wiley 8 Sons.
[9]
Monidipa Das and Soumya K. Ghosh. 2016. A cost-efficient approach for measuring Moran’s index of spatial autocorrelation in geostationary satellite data. In 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE, 5913--5916.
[10]
Monidipa Das and Soumya K. Ghosh. 2016. Deep-STEP: A deep learning approach for spatiotemporal prediction of remote sensing data. IEEE Geoscience and Remote Sensing Letters 13, 12 (2016), 1984--1988.
[11]
Monidipa Das and Soumya K. Ghosh. 2017. A deep-learning-based forecasting ensemble to predict missing data for remote sensing analysis. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10, 12 (2017), 5228--5236.
[12]
Monidipa Das and Soumya K. Ghosh. 2017. Measuring Moran’s I in a cost-efficient manner to describe a land-cover change pattern in large-scale remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10, 6 (2017), 2631--2639.
[13]
Monidipa Das and Soumya K. Ghosh. 2019. Space-time prediction of high resolution raster data: An approach based on spatio-temporal Bayesian network (STBN). In Proceedings of the ACM India Joint International Conference on Data Science and Management of Data. ACM, 129--135.
[14]
Monidipa Das, Mahardhika Pratama, Andri Ashfahani, and Subhrajit Samanta. 2019. FERNN: A fast and evolving recurrent neural network model for streaming data classification. In 2019 International Joint Conference on Neural Networks (IJCNN). 1--8.
[15]
Li Deng and Dong Yu. 2014. Deep learning: Methods and applications. Foundations and Trends in Signal Processing 7, 3--4 (2014), 197--387.
[16]
Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. 2016. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38, 2 (2016), 295--307.
[17]
ESRI. 2017. ArcGIS for Desktop. Retrieved December 12, 2017 from http://www.esri.com/software/arcgis/ arcgis-for-desktop.
[18]
Isvani Frías-Blanco, José del Campo-Ávila, Gonzalo Ramos-Jiménez, Rafael Morales-Bueno, Agustín Ortiz-Díaz, and Yailé Caballero-Mota. 2015. Online and non-parametric drift detection methods based on Hoeffdings bounds. IEEE Transactions on Knowledge and Data Engineering 27, 3 (2015), 810--823.
[19]
Florian Gerber, Rogier de Jong, Michael E. Schaepman, Gabriela Schaepman-Strub, and Reinhard Furrer. 2018. Predicting missing values in spatio-temporal remote sensing data. IEEE Transactions on Geoscience and Remote Sensing 56, 5 (2018), 2841--2853.
[20]
Rafael C. Gonzalez, Richard E. Woods, et al. 2002. Digital image processing [M]. Publishing House of Electronics Industry 141, 7 (2002).
[21]
Ian Goodfellow, Yoshua Bengio, Aaron Courville, and Yoshua Bengio. 2016. Deep Learning. Vol. 1. MIT Press Cambridge.
[22]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778.
[23]
Neal Jean, Marshall Burke, Michael Xie, W. Matthew Davis, David B. Lobell, and Stefano Ermon. 2016. Combining satellite imagery and machine learning to predict poverty. Science 353, 6301 (2016), 790--794.
[24]
CY Ji. 2008. Haze reduction from the visible bands of LANDSAT TM and ETM+ images over a shallow water reef environment. Remote Sensing of Environment 112, 4 (2008), 1773--1783.
[25]
Jintao Ke, Hai Yang, Hongyu Zheng, Xiqun Chen, Yitian Jia, Pinghua Gong, and Jieping Ye. 2018. Hexagon-based convolutional neural network for supply-demand forecasting of ride-sourcing services. IEEE Transactions on Intelligent Transportation Systems (2018).
[26]
Chao-Hung Lin, Po-Hung Tsai, Kang-Hua Lai, and Jyun-Yuan Chen. 2013. Cloud removal from multitemporal satellite images using information cloning. IEEE Transactions on Geoscience and Remote Sensing 51, 1 (2013), 232--241.
[27]
Frank Silvio Marzano, Giancarlo Rivolta, Erika Coppola, Barbara Tomassetti, and Marco Verdecchia. 2007. Rainfall nowcasting from multisatellite passive-sensor images using a recurrent neural network. IEEE Transactions on Geoscience and Remote Sensing 45, 11 (2007), 3800--3812.
[28]
Binh Thai Pham, Dieu Tien Bui, Hamid Reza Pourghasemi, Prakash Indra, and MB Dholakia. 2017. Landslide susceptibility assesssment in the Uttarakhand area (India) using GIS: A comparison study of prediction capability of Naïve Bayes, multilayer perceptron neural networks, and functional trees methods. Theoretical and Applied Climatology 128, 1--2 (2017), 255--273.
[29]
Mahardhika Pratama, Choiru Za’in, Andri Ashfahani, Yew Soon Ong, and Weiping Ding. 2019. Automatic construction of multi-layer perceptron network from streaming examples. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1171--1180.
[30]
Atiqur Rahman, Shiv Prashad Aggarwal, Maik Netzband, and Shahab Fazal. 2011. Monitoring urban sprawl using remote sensing and GIS techniques of a fast growing urban centre, India. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 4, 1 (2011), 56--64.
[31]
Fernando Sedano, Pieter Kempeneers, and George Hurtt. 2014. A Kalman filter-based method to generate continuous time series of medium-resolution NDVI images. Remote Sensing 6, 12 (2014), 12381--12408.
[32]
Xingjian Shi, Zhihan Gao, Leonard Lausen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, and Wang-chun Woo. 2017. Deep learning for precipitation nowcasting: A benchmark and a new model. In Advances in Neural Information Processing Systems. 5617--5627.
[33]
K. Sowmya, C. M. John, and N. K. Shrivasthava. 2015. Urban flood vulnerability zoning of Cochin City, southwest coast of India, using remote sensing and GIS. Natural Hazards 75, 2 (2015), 1271--1286.
[34]
Vandana Tomar, Vinay Prasad Mandal, Pragati Srivastava, Shashikanta Patairiya, Kartar Singh, Natesan Ravisankar, Natraj Subash, and Pavan Kumar. 2014. Rice equivalent crop yield assessment using MODIS sensors based MOD13A1-NDVI data. IEEE Sensors Journal 14, 10 (2014), 3599--3605.
[35]
USGS-EarthExplorer. 2019. Land Processes Distributed Active Archive Center. Retrieved August 2019 from https://lpdaac.usgs.gov/data_access/usgs_earthexplorer.
[36]
Dianhui Wang and Ming Li. 2017. Stochastic configuration networks: Fundamentals and algorithms. IEEE Transactions on Cybernetics 47, 10 (2017), 3466--3479.
[37]
Laigang Wang, Yongchao Tian, Xia Yao, Yan Zhu, and Weixing Cao. 2014. Predicting grain yield and protein content in wheat by fusing multi-sensor and multi-temporal remote-sensing images. Field Crops Research 164 (2014), 178--188.
[38]
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600--612.
[39]
Geoffrey I. Webb, Loong Kuan Lee, Bart Goethals, and François Petitjean. 2018. Analyzing concept drift and shift from sample data. Data Mining and Knowledge Discovery 32, 5 (2018), 1179--1199.
[40]
SHI Xingjian, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In Advances in Neural Information Processing Systems. 802--810.
[41]
Yuting Yang, Junyu Dong, Xin Sun, Estanislau Lima, Quanquan Mu, and Xinhua Wang. 2017. A CFCC-LSTM model for sea surface temperature prediction. IEEE Geoscience and Remote Sensing Letters 15, 2 (2017), 207--211.
[42]
Huaxiu Yao, Xianfeng Tang, Hua Wei, Guanjie Zheng, and Zhenhui Li. 2019. Revisiting spatial-temporal similarity: A deep learning framework for traffic prediction. In AAAI Conference on Artificial Intelligence.
[43]
Huaxiu Yao, Fei Wu, Jintao Ke, Xianfeng Tang, Yitian Jia, Siyu Lu, Pinghua Gong, Jieping Ye, and Zhenhui Li. 2018. Deep multi-view spatial-temporal network for taxi demand prediction. In Thirty-Second AAAI Conference on Artificial Intelligence.
[44]
Jiaxuan You, Xiaocheng Li, Melvin Low, David Lobell, and Stefano Ermon. 2017. Deep gaussian process for crop yield prediction based on remote sensing data. In AAAI. 4559--4566.
[45]
Lijing Yu, Lingling Zhou, Li Tan, Hongbo Jiang, Ying Wang, Sheng Wei, and Shaofa Nie. 2014. Application of a new hybrid model with seasonal auto-regressive integrated moving average (ARIMA) and nonlinear auto-regressive neural network (NARNN) in forecasting incidence cases of HFMD in Shenzhen, China. PloS One 9, 6 (2014), e98241.
[46]
Qin Zhang, Hui Wang, Junyu Dong, Guoqiang Zhong, and Xin Sun. 2017. Prediction of sea surface temperature using long short-term memory. IEEE Geoscience and Remote Sensing Letters 14, 10 (2017), 1745--1749.

Cited By

View all
  • (2024)Artificial Intelligence-Enabled Metaverse for Sustainable Smart Cities: Technologies, Applications, Challenges, and Future DirectionsElectronics10.3390/electronics1324487413:24(4874)Online publication date: 10-Dec-2024
  • (2024)Continual Learning for Smart City: A SurveyIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.344712336:12(7805-7824)Online publication date: Dec-2024
  • (2024)Toward Causality-Based Explanation of Aerial Scene ClassifiersIEEE Geoscience and Remote Sensing Letters10.1109/LGRS.2023.333671021(1-5)Online publication date: 2024
  • Show More Cited By

Index Terms

  1. SARDINE: A Self-Adaptive Recurrent Deep Incremental Network Model for Spatio-Temporal Prediction of Remote Sensing Data

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Spatial Algorithms and Systems
    ACM Transactions on Spatial Algorithms and Systems  Volume 6, Issue 3
    Special Issue on Deep Learning for Spatial Algorithms and Systems
    September 2020
    171 pages
    ISSN:2374-0353
    EISSN:2374-0361
    DOI:10.1145/3394669
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 April 2020
    Accepted: 01 January 2020
    Revised: 01 September 2019
    Received: 01 May 2019
    Published in TSAS Volume 6, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Spatio-temporal prediction
    2. evolving RNN
    3. incremental model
    4. remote sensing

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 25 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Artificial Intelligence-Enabled Metaverse for Sustainable Smart Cities: Technologies, Applications, Challenges, and Future DirectionsElectronics10.3390/electronics1324487413:24(4874)Online publication date: 10-Dec-2024
    • (2024)Continual Learning for Smart City: A SurveyIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.344712336:12(7805-7824)Online publication date: Dec-2024
    • (2024)Toward Causality-Based Explanation of Aerial Scene ClassifiersIEEE Geoscience and Remote Sensing Letters10.1109/LGRS.2023.333671021(1-5)Online publication date: 2024
    • (2023)Remote sensing scene classification under scarcity of labelled samples—A survey of the state-of-the-artsComputers & Geosciences10.1016/j.cageo.2022.105295171(105295)Online publication date: Feb-2023
    • (2023)An autonomous lightweight model for aerial scene classification under labeled sample scarcityApplied Intelligence10.1007/s10489-023-04694-253:19(22216-22227)Online publication date: 1-Oct-2023
    • (2022)A Multilayered Adaptive Recurrent Incremental Network Model for Heterogeneity-Aware Prediction of Derived Remote Sensing Image Time SeriesIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2022.315347960(1-13)Online publication date: 2022
    • (2022)Forecasting vegetation indices from spatio-temporal remotely sensed data using deep learning-based approaches: A systematic literature reviewEcological Informatics10.1016/j.ecoinf.2022.10155268(101552)Online publication date: May-2022
    • (2021)A novel CNN-LSTM-based approach to predict urban expansionEcological Informatics10.1016/j.ecoinf.2021.10132564(101325)Online publication date: Sep-2021
    • (2021)Real-time prediction of spatial raster time series: a context-aware autonomous learning modelJournal of Real-Time Image Processing10.1007/s11554-021-01099-718:5(1591-1605)Online publication date: 1-Oct-2021
    • (2020)Online Prediction of Derived Remote Sensing Image Time Series: An Autonomous Machine Learning ApproachIGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium10.1109/IGARSS39084.2020.9324428(1496-1499)Online publication date: 26-Sep-2020

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media