short-paper

Using DynamoGraph: application scenarios for large-scale temporal graph processing

Authors:

Matthias Steinbauer,

Gabriele Anderst-KotsisAuthors Info & Claims

iiWAS '15: Proceedings of the 17th International Conference on Information Integration and Web-based Applications & Services

Article No.: 76, Pages 1 - 5

https://doi.org/10.1145/2837185.2843858

Published: 11 December 2015 Publication History

Abstract

Current trends in graph analytics show a trend towards analysing networks of ever growing size and a strong interest of analysing chronological development in networks. This paper provides a brief introduction to possible processing paradigms for large-scale temporal graphs and a real-world implementation called DynamoGraph. The paper motivates the necessity of further research in this area by highlighting three use-case scenarios. It is elaborated how the click-behavior of users visiting the web can be used to better understand the structure of the actively used web, it shows how temporal graphs provide a model for social network analysis over online discourse, and it provides first insight in how temporal graph analytics can help us better understand social learning networks.

References

[1]

V. D. Blondel, J.-L. Guillaume, R. Lambiotte, and E. Lefebvre. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, (10), Oct. 2008.

[2]

G. Cardone, A. Cirri, A. Corradi, L. Foschini, and D. Maio. MSF: An Efficient Mobile Phone Sensing Framework. International Journal of Distributed Sensor Networks, 2013(4):1--9, 2013.

[3]

C. Cattuto, M. Quaggiotto, A. Panisson, and A. Averbuch. Time-varying social networks in a graph database: a Neo4j use case. ACM, New York, New York, USA, June 2013.

[4]

A. Clauset, M. Newman, and C. Moore. Finding Community Structure in Very Large Networks. Physical Review E, 70(6):066111, Dec. 2004.

[5]

A. Clementi, R. Silvestri, and L. Trevisan. Information Spreading in Dynamic Graphs. In Symposium on Principles of Distributed Computing, pages 37--46, New York, New York, USA, 2012. ACM Press.

[6]

N. Eagle and A. Pentland. Reality mining: sensing complex social systems. Personal and Ubiquitous Computing, 2006.

Digital Library

[7]

R. Ecker. Creation of Internet Relay Chat Nicknames and Their Usage in English Chatroom Discourse. Linguistik Online, 50(6):108c--108c, 2011.

[8]

W. Hant, Y. Miao, K. Li, M. Wu, F. Yang, L. Zhou, V. Prabhakaran, W. Chen, and E. Chen. Chronos. In the Ninth European Conference, pages 1--14, New York, New York, USA, 2014. ACM Press.

[9]

F. Harary and G. Gupta. Dynamic Graph Models. Mathl. Comput. Modelling, 25(7):79--87, 1997.

Digital Library

[10]

M. Jacomy, S. Heymann, T. Venturini, and M. Bastian. ForceAtlas2, A Graph Layout Algorithm for Handy Network Visualization. Technical report, Aug. 2011.

[11]

U. Kang, C. E. Tsourakakis, and C. Faloutsos. PEGASUS: A Peta-Scale Graph Mining System - Implementation and Observations. In 2009 Ninth IEEE International Conference on Data Mining (ICDM), pages 229--238, 2009.

Digital Library

[12]

D. Kempe, J. Kleinberg, and A. Kumar. Connectivity and Inference Problems for Temporal Networks. International Journal of Computer and System Sciences, 64(4):820--842, 2002.

Digital Library

[13]

T. Kim, A. Chang, and A. Pentland. Enhancing organizational communication using sociometric badges. Proceedings of the 11th International Symposium on Wearable Computers (Submitted), 2007.

[14]

K. Kitto, S. Cross, Z. Waters, and M. Lupton. Learning analytics beyond the LMS: the Connected Learning Analytics toolkit. In Learing Analytics and Knowledge LAK, Poughkeepsie, 2015. ACM.

Digital Library

[15]

V. Kostakos. Temporal graphs. Physica A: Statistical Mechanics and its Applications, 388(6):1007--1023, 2009.

[16]

G. Malewicz, M. Austern, A. Bik, J. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: A System for Large-Scale Graph Processing. In ACM SIGMOD International Conference on Management of Data, 2010.

Digital Library

[17]

M. Meiss, F. Menczer, S. Fortunato, A. Flammini, and A. Vespignani. Ranking web sites with real user traffic. In Proc. First ACM International Conference on Web Search and Data Mining (WSDM), pages 65--75, 2008.

Digital Library

[18]

Y. Miao, W. Han, K. Li, M. Wu, F. Yang, L. Zhou, V. Prabhakaran, E. Chen, and W. Chen. ImmortalGraph: A System for Storage and Analysis of Temporal Graphs. ACM Transactions on Storage (TOS), 11(3):14--34, July 2015.

[19]

V. Nicosia, J. Tang, C. Mascolo, M. Musolesi, G. Russo, and V. Latora. Graph Metrics for Temporal Networks. In Temporal Networks, pages 1--27. Jan. 2014.

[20]

L. Page, S. Brin, R. Motwani, and T. Winograd. The PageRank citation ranking: bringing order to the web. 1999.

[21]

S. Salihoglu and J. Widom. GPS: a graph processing system. In SSDBM: Proceedings of the 25th International Conference on Scientific and Statistical Database Management. ACM Request Permissions, July 2013.

Digital Library

[22]

A. Sallaberry, C. Muelder, and K.-L. Ma. Clustering, Visualizing, and Navigating for Large Dynamic Graphs. In 20th International Symposium on Graph Drawing, Sept. 2012.

[23]

G. Siemens. Connectivism: A Learning Theory for the Digital Age. International Journal of Instructional Technology and Distance Learning, 2(1), Jan. 2005.

[24]

M. Steinbauer and G. Anderst-Kotsis. DynamoGraph: Extending the Pregel Paradigm for Large-scale Temporal Graph Processing. To appear: International Journal on Grid and Utility Computing, Jan. 2015.

[25]

J. Tang, M. Musolesi, C. Mascolo, and V. Latora. Characterising temporal distance and reachability in mobile and online social networks. In ACM SIGCOMM Computer Communication Review, pages 118--124. ACM, Jan. 2010.

Digital Library

[26]

J. K. Tang. Temporal network metrics and their application to real world networks. PhD thesis, Robinson College University of Cambridge, Dec. 2011.

[27]

H. Tong, S. Papadimitriou, J. Sun, P. S. Yu, and C. Faloutsos. Colibri: Fast Mining of Large Static and Dynamic Graphs. In 14th ACM SIGKDD international conference on Knowledge discovery and data mining, page 686, 2008.

Digital Library

[28]

M. Trier. Research Note---Towards Dynamic Visualization for Understanding Evolution of Digital Communication Networks. Information Systems Research, 19(3):335--350, Sept. 2008.

[29]

Z. Xiao, L. Guo, and J. Tracey. Understanding Instant Messaging Traffic Characteristics. In 27th International Conference on Distributed Computing Systems, 2007.

Cited By

Steinbauer MAnderst-Kotsis GBourdeau JHendler JNkambou RHorrocks IZhao B(2016)DynamoGraphProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2889293(861-866)Online publication date: 11-Apr-2016
https://dl.acm.org/doi/10.1145/2872518.2889293

Index Terms

Using DynamoGraph: application scenarios for large-scale temporal graph processing
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

DynamoGraph: A Distributed System for Large-scale, Temporal Graph Processing, its Implementation and First Observations
WWW '16 Companion: Proceedings of the 25th International Conference Companion on World Wide Web

Graph models have a long standing history as models for real world structures and processes. In recent research two important dimensions of graphs are described of particular importance. (1) Temporal aspects of graphs cannot be neglected for many ...
DynamoGraph: extending the Pregel paradigm for large-scale temporal graph processing

Large-scale temporal graphs can serve as a model in many application scenarios. Owing to the popularity of online social networks and increased research interest in gathering and analysing data about human behaviour and interaction reality mining ...
A mathematical model for friend discovery from dynamic social graphs
ASONAM '21: Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining

Nowadays, social networking is popular. As such, numerous social networking sites (e.g., Facebook, YouTube, Instagram) are generating very large volumes of social data rapidly. Valuable knowledge and information is embedded into these big social data, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

iiWAS '15: Proceedings of the 17th International Conference on Information Integration and Web-based Applications & Services

December 2015

704 pages

ISBN:9781450334914

DOI:10.1145/2837185

General Chair:
Gabriele Anderst-Kotsis
Johannes Kepler University Linz, Austria
,
Program Chair:
Maria Indrawan-Santiago
Monash University, Australia

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

iiWAS '15

iiWAS '15: The 17th International Conference on Information Integration and Web-based Application & Services

December 11 - 13, 2015

Brussels, Belgium

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
67
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Steinbauer MAnderst-Kotsis GBourdeau JHendler JNkambou RHorrocks IZhao B(2016)DynamoGraphProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2889293(861-866)Online publication date: 11-Apr-2016
https://dl.acm.org/doi/10.1145/2872518.2889293

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents