Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2487788.2487986acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Analysis of large scale climate data: how well climate change models and data from real sensor networks agree?

Published: 13 May 2013 Publication History

Abstract

Research on global warming and climate changes has attracted a huge attention of the scientific community and of the media in general, mainly due to the social and economic impacts they pose over the entire planet. Climate change simulation models have been developed and improved to provide reliable data, which are employed to forecast effects of increasing emissions of greenhouse gases on a future global climate. The data generated by each model simulation amount to Terabytes of data, and demand fast and scalable methods to process them. In this context, we propose a new process of analysis aimed at discriminating between the temporal behavior of the data generated by climate models and the real climate observations gathered from ground-based meteorological station networks. Our approach combines fractal data analysis and the monitoring of real and model-generated data streams to detect deviations on the intrinsic correlation among the time series defined by different climate variables. Our measurements were made using series from a regional climate model and the corresponding real data from a network of sensors from meteorological stations existing in the analyzed region. The results show that our approach can correctly discriminate the data either as real or as simulated, even when statistical tests fail. Those results suggest that there is still room for improvement of the state-of-the-art climate change models, and that the fractal-based concepts may contribute for their improvement, besides being a fast, parallelizable, and scalable approach.

References

[1]
P. Ahlgren, B. Jarneving, and R. Rousseau. Requirements for a cocitation similarity measure, with special reference to pearson's correlation coefficient. Journal of the American Society for Information Science and Technology, 54(6):550--560, 2003.
[2]
L. M. Alves and J. A. Marengo. Assessment of regional seasonal predictability using the PRECIS regional climate modeling system over south america. Theoretical and Applied Climatology, 100:337--350, 2010.
[3]
T. e. a. Ambrizzi. Cenários regionalizados de clima no brasil para o século xxi: projeções de clima usando três modelos regionais: relatírio 3. Technical report, MMA, Brasilia, 2007.
[4]
E. D. Assad, H. S. Pinto, and J. J. Zullo. Impacts of global warming in the brazilian agroclimatic risk zoning. In A Contribution to Understanding the Regional Impacts of Global Change in South America, pages 175--182, São Paulo, Brazil, 2007. Instituto de Estudos Avançados da USP.
[5]
G. B. Baioco, A. J. M. Traina, and C. Traina. Mamcost: Global and local estimates leading to robust cost estimation of similarity queries. In SSDBM 2007, pages 6--16, Banff, Canada, 2007. ACM Press.
[6]
D. Barbará and P. Chen. Fractal mining - self similarity-based clustering and its applications. In O. Maimon and L. Rokach, editors, Data Mining and Knowledge Discovery Handbook, pages 573--589. Springer, 2010.
[7]
D. Barbará and P. Chen. Using the fractal dimension to cluster datasets. In ACM SIGKDD, pages 260--264, Boston, MA, 2000.
[8]
T. Black. The new nmc mesoscale eta/cptec model: Description and forecast examples. Forecasting, 9:265--278, 1994.
[9]
C. Böhm. A cost model for query processing in high dimensional data spaces. ACM TODS, 25(2):129--178, 2000.
[10]
D. Chakrabarti and C. Faloutsos. F4: large-scale automated forecasting using fractals. In CIKM, volume 1, pages 2--9, McLean, VA - EUA, 2002. ACM Press.
[11]
S. C. Chou, J. A. Marengo, A. A. Lyra, G. Sueiro, J. F. Pesquero, L. M. Alves, G. Kay, R. Betts, D. J. G. Chagas, L. Jorge, Bustamante, and P. Tavares. Downscaling of south america present climate driven by 4-member hadcm3 runs. Springer - ClimDyn, 25:33--59, 2007.
[12]
R. L. F. Cordeiro, A. J. M. Traina, C. Faloutsos, and C. Traina. Finding clusters in subspaces of very large, multi-dimensional datasets. In Proceedings of the 26th International Conference on Data Engineering (ICDE 2010), pages 625--636, Long Beach, California, USA, 2010. IEEE.
[13]
R. L. F. Cordeiro, A. J. M. Traina, C. Faloutsos, and C. Traina. Halite: Fast and scalable multiresolution local-correlation clustering. IEEE Trans. Knowl. Data Eng., 25(2):387--401, 2013.
[14]
Djuric and Dusan. Weather Analysis - Chapter I. Prentice-Hall Inc., 1994.
[15]
C. Faloutsos and I. Kamel. Beyond uniformity and independence: Analysis of r-trees using the concept of fractal dimension. In ACM PODS, pages 4--13, Minneapolis, MN, 1994.
[16]
C. Faloutsos, B. Seeger, A. J. M. Traina, and C. Traina. Spatial join selectivity using power laws. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (SIGMOD'00), pages 177--188, Dallas, USA, May 2000.
[17]
C. B. Field, V. Barros, T. F. Stocker, D. Qin, D. J. Dokken, K. L. Ebi, M. D. Mastrandrea, K. J. Mach, G. K. Plattner, S. K. Allen, M. Tignor, and P. M. Midgley, editors. Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation. A Special Report of Working Groups I and II of the Intergovernmental Panel on Climate Change. Cambridge University Press, 2012.
[18]
P. Forster, V. Ramaswamy, P. Artaxo, T. Berntsen, R. Betts, D. W. Fahey, J. Haywood, J. Lean, D. C. Lowe, G. Myhre, J. Nganga, R. Prinn, G. Raga, M. Schulz, and R. V. Dorland. 2007: Changes in Atmospheric Constituents and in Radiative Forcing. In: Climate Change 2007: The Physical Science Basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press, 2007.
[19]
Intergovernmental Panel on Climate Change - IPCC. Climate change 2007: Fourth assessment report (AR4). Cambridge University Press, Cambridge, UK, 2007.
[20]
Intergovernmental Panel on Climate Change - IPCC. Climate Change 2007: Summary for Policymakers. Cambridge Univ. Press., 2007. Formally agreed statement of the IPCC concerning key findings and uncertainties contained in the Working Group contributions to the Fourth Assessment Report.
[21]
IPCC. Intergovernmental panel on climate change. http://www.ipcc.ch/ipccreports/index.htm, 2007. accessed: March, 2009.
[22]
D. R. Legates and G. J. McCabe. Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation. Water Resources Res., 35(1):233--241, 1999.
[23]
J. A. Marengo, R. Jones, L. M. Alves, and M. C. Valverde. Future change of temperature and precipitation extremes in south america as derived from the PRECIS regional climate modeling system. International Journal of Climatology, 29(15):2241--2255, 2009.
[24]
D. N. Moriasi, J. G. Arnold, M. W. Van Liew, R. L. Bingner, R. D. Harmel, and T. L. Veith. Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Transactions of the ASABE, 50(3):885--900, 2007.
[25]
NASA's Goddard Institute for Space Studies. Nasa research finds 2010 tied for warmest year on record. {Online}. Available at: http://www.nasa.gov/topics/earth/features/2010-warmest-year.html, Day of access: September 1, 2012.
[26]
Petersen. Weather Analysis and Forecasting. 1956.
[27]
H. S. Pinto and E. D. Assad. Global warming and the new geography of agricultural production in Brazil. page 42pp, Brasília, Brazil, 2008. The British Embassy.
[28]
H. S. Pinto and E. D. Assad. Impacts of climate change on brazilian agriculture. In Brazil: Assessment of the Vulnerability and Impacts of Climate Change on Brazilian Agriculture. Development report for World Bank Project P118037, 2012.
[29]
M. Schroeder. Fractals, Chaos, Power Laws. W. H. Freeman and Company, 1991.
[30]
E. P. M. Sousa, C. Traina, A. J. M. Traina, and C. Faloutsos. Measuring evolving data streams' behavior through their intrinsic dimension. New Generation Computing Journal, 25:33--59, 2007.
[31]
E. P. M. Sousa, C. Traina, A. J. M. Traina, L. Wu, and C. Faloutsos. A fast and effective method to find correlations among attributes in databases. DMKD, 14(3):367--407, 2007.
[32]
The National Academies. Understanding and Responding to Climate Change: Highlights of National Academies Reports. The National Academies, 2008.
[33]
C. Traina, E. P. M. Sousa, and A. J. M. Traina. Using fractals in data mining. In M. M. Kantardzic and J. Zurada, editors, New Generation of Data Mining Applications, volume 1, pages 599--630 (Chapter 24). Wiley/IEEE Press, 2005.
[34]
C. Traina, A. J. M. Traina, L. Wu, and C. Faloutsos. Fast feature selection using fractal dimension. Journal of Information and Data Management - JIDM, 1(1):3--16, 2010.
[35]
C. Traina, A. J. M. Traina, L. Wu, and C. Faloutsos. Fast feature selection using fractal dimension - ten years later. Journal of Information and Data Management - JIDM, 1(1):17--20, 2010.
[36]
C. J. Willmott. On the validation of models. Physical Geography, 2:184--194, 1981.
[37]
C. J. Willmott. On the evaluation of model performance in physical geography. Gaile and Willmott, eds. Norwell, 1984.
[38]
C. J. Willmott, R. Davis, J. Feddema, K. Klink, D. Legates, C. Rowe, S. Ackleson, and J. O'Donnell. Statistics for the evaluation and comparison of models. JOURNAL OF GEOPHYSICAL RESEARCH, 90:8995--9005, Sept. 1985.
[39]
C. J. Willmott, S. M. Robeson, and K. Matsuura. A refined index of model performance. International Journal of Climatology, 32(13):2088--2094, 2012.

Cited By

View all
  • (2018)Definition of a temporal distribution index for high temporal resolution precipitation data over Peninsular Spain and the Balearic Islands: the fractal dimension; and its synoptic implicationsClimate Dynamics10.1007/s00382-018-4159-652:1-2(439-456)Online publication date: 8-Mar-2018
  • (2016)Big data research in climate science2016 International Conference on Communication and Electronics Systems (ICCES)10.1109/CESYS.2016.7889855(1-6)Online publication date: Oct-2016

Index Terms

  1. Analysis of large scale climate data: how well climate change models and data from real sensor networks agree?

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    WWW '13 Companion: Proceedings of the 22nd International Conference on World Wide Web
    May 2013
    1636 pages
    ISBN:9781450320382
    DOI:10.1145/2487788

    Sponsors

    • NICBR: Nucleo de Informatcao e Coordenacao do Ponto BR
    • CGIBR: Comite Gestor da Internet no Brazil

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 May 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. climate data
    2. data streams
    3. fractal analysis
    4. sensor networks

    Qualifiers

    • Research-article

    Conference

    WWW '13
    Sponsor:
    • NICBR
    • CGIBR
    WWW '13: 22nd International World Wide Web Conference
    May 13 - 17, 2013
    Rio de Janeiro, Brazil

    Acceptance Rates

    WWW '13 Companion Paper Acceptance Rate 831 of 1,250 submissions, 66%;
    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 12 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Definition of a temporal distribution index for high temporal resolution precipitation data over Peninsular Spain and the Balearic Islands: the fractal dimension; and its synoptic implicationsClimate Dynamics10.1007/s00382-018-4159-652:1-2(439-456)Online publication date: 8-Mar-2018
    • (2016)Big data research in climate science2016 International Conference on Communication and Electronics Systems (ICCES)10.1109/CESYS.2016.7889855(1-6)Online publication date: Oct-2016

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media