research-article

An Open Dataset of Operational Mobile Networks

Authors:

Ali Safari Khatouni,

Martino Trevisan,

Danilo Giordano,

Mohammad Rajiullah,

Stefan Alfredsson,

Anna Brunstrom,

Özgü AlayAuthors Info & Claims

MobiWac '20: Proceedings of the 18th ACM Symposium on Mobility Management and Wireless Access

Pages 83 - 90

https://doi.org/10.1145/3416012.3424619

Published: 16 November 2020 Publication History

Abstract

Mobile networks have become ubiquitous and the primary means to access the Internet, and the traffic they generate has rapidly increased over the last years. The technology and service diversity in mobile networks call for extensive and accurate measurements to ensure the proper functioning of the networks and rapidly spot impairments. However, the measurement of mobile networks is complicated by their scale, and, thus, expensive, especially due to the diversity of deployments, technologies, and web services. In this paper, we present and provide access to the largest open international mobile network dataset collected using the MONROE platform spanning six countries, 27 mobile network operators, and 120 measurement nodes. We use them to run measurements targeting several web services from January 2018 to December 2019, collecting millions of TCP and UDP flows using these commercial mobile networks. We illustrate the data collection platforms and describe some of the main experiments. Besides a high-level overview of the dataset, we provide two practical use cases. First, we show how our data can be used as a proxy for web service performance. Second, we study the content delivery infrastructure of Facebook.

References

[1]

[n.d.]. MONROE-Browsertime. https://github.com/MONROE-PROJECT/Experiments/. [Online; accessed 18-Jul-2020].

[2]

[n.d.]. sitespeedio/browsertime: Your browser, your page, your scripts! https://github.com/sitespeedio/browsertime. [Online; accessed 20-Feb-2019].

[3]

[n.d.]. Xvfb manual. https://goo.gl/EPBtpt. [Online; accessed 20-Feb-2019].

[4]

Ö. Alay, A. Lutu, M. Peón-Quirós, V. Mancuso, T. Hirsch, K. Evensen, A. Hansen, S. Alfredsson, J. Karlsson, A. Brunstrom, A. Safari Khatouni, M. Mellia, and M. Ajmone Marsan. 2017. Experience: An Open Platform for Experimentation with Commercial Mobile Broadband Networks. Proc. ACM MobiCom '17 (2017), 70--78. https://doi.org/10.1145/3117811.3117812

Digital Library

[5]

Alexa. 2017. The top sites on the web. https://www.alexa.com/topsites. [Online; accessed 24-Jul-2020].

[6]

Daniele Apiletti, Elena Baralis, Tania Cerquitelli, Paolo Garza, Danilo Giordano, Marco Mellia, and Luca Venturini. 2016. SeLINA: A self-learning insightful network analyzer. IEEE Transactions on Network and Service Management, Vol. 13, 3 (2016), 696--710.

Digital Library

[7]

T Barnett, S Jain, U Andra, and T Khurana. 2018. Cisco Visual Networking Index (VNI), Complete Forecast Update, 2017--2022. Americas/EMEAR Cisco Knowledge Network (CKN) Presentation (2018).

[8]

M. Belshe, R. Peon, and M. Thomson. 2015. Hypertext Transfer Protocol Version 2 (HTTP/2). RFC 7540 (Proposed Standard).

[9]

Ignacio Bermudez, Marco Mellia, Maurizio M. Munafò, Ram Keralapura, and Antonio Nucci. 2012. DNS to the Rescue: Discerning Content and Services in a Tangled Web. In Proceedings of the ACM SIGCOMM Internet Measurement Conference (IMC'12). 413--426. http://doi.acm.org/10.1145/2398776.2398819

Digital Library

[10]

Enrico Bocchi, Luca De Cicco, and Dario Rossi. 2016. Measuring the Quality of Experience of Web users. ACM SIGCOMM Computer Communication Review, Vol. 46, 4 (2016), 8--13.

Digital Library

[11]

FCC. 2013. 2013 Measuring Broadband America February Report. Technical Report. FCC's Office of Engineering and Technology and Consumer and Governmental Affairs Bureau.

[12]

R. Fielding et al. 1999. Hypertext Transfer Protocol -- HTTP/1.1. RFC 2616 (Draft Standard).

Digital Library

[13]

Danilo Giordano, Stefano Traverso, Luigi Grimaudo, Marco Mellia, Elena Baralis, Alok Tongaonkar, and Sabyasachi Saha. 2015a. YouLighter: A cognitive approach to unveil YouTube CDN and changes. IEEE Transactions on Cognitive Communications and Networking, Vol. 1, 2 (2015), 161--174.

[14]

Danilo Giordano, Stefano Traverso, Luigi Grimaudo, Marco Mellia, Elena Baralis, Alok Tongaonkar, and Sabyasachi Saha. 2015b. Youlighter: An unsupervised methodology to unveil youtube cdn changes. In 2015 27th International Teletraffic Congress. IEEE, 19--27.

Digital Library

[15]

Rick Hofstede, Pavel v Celeda, Brian Trammell, Idilio Drago, Ramin Sadre, Anna Sperotto, and Aiko Pras. 2014. Flow Monitoring Explained: From Packet Capture to Data Analysis with NetFlow and IPFIX. Commun. Surveys Tuts., Vol. 16, 4 (2014), 2037--2064.

[16]

Ali Safari Khatouni, Marco Ajmone Marsan, Marco Mellia, and Reza Rejaie. 2018. Deadline-constrained content upload from multihomed devices: Formulations and algorithms. Computer Networks, Vol. 142 (2018), 76 -- 92. https://doi.org/10.1016/j.comnet.2018.06.008

[17]

Ali Safari Khatouni, Marco Mellia, Marco Ajmone Marsan, Stefan Alfredsson, Jonas Karlsson, Anna Brunstrom, Ozgu Alay, Andra Lutu, Cise Midoglu, and Vincenzo Mancuso. 2017a. Speedtest-like Measurements in 3G/4G Networks: The MONROE Experience. In Teletraffic Congress (ITC 29), 2017 29th International, Vol. 1. IEEE, 169--177.

[18]

Ali Safari Khatouni, Martino Trevisan, Leonardo Regano, and Alessio Viticchié. 2017b. Privacy issues of isps in the modern web. In 2017 8th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). IEEE, 588--594.

[19]

Adam Langley, Alistair Riddoch, Alyssa Wilk, Antonio Vicente, Charles Krasic, Dan Zhang, Fan Yang, Fedor Kouranov, Ian Swett, Janardhan Iyengar, Jeff Bailey, Jeremy Dorfman, Jim Roskind, Joanna Kulik, Patrik Westin, Raman Tenneti, Robbie Shade, Ryan Hamilton, Victor Vasiliev, Wan-Teh Chang, and Zhongyi Shi. 2017. The QUIC Transport Protocol: Design and Internet-Scale Deployment. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (Los Angeles, CA, USA) (SIGCOMM '17). ACM, New York, NY, USA, 183--196. https://doi.org/10.1145/3098822.3098842

Digital Library

[20]

Vincenzo Mancuso and et al. 2019. Results from running an experiment as a service platform for mobile broadband networks in Europe. Computer Communications, Vol. 133 (2019), 89 -- 101.

[21]

Anna Maria Mandalari, Andra Lutu, Ana Custura, Ali Safari Khatouni, Özgü Alay, Marcelo Bagnulo, Vaibhav Bajpai, Anna Brunstrom, Jörg Ott, Marco Mellia, and Gorry Fairhurst. 2018. Experience: Implications of Roaming in Europe. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (New Delhi, India) (MobiCom '18). Association for Computing Machinery, New York, NY, USA, 179--189. https://doi.org/10.1145/3241539.3241577

Digital Library

[22]

Cise Midoglu. 2020. Large Scale Speedtest Experimentation in Mobile Broadband Networks. https://mosaic-simulamet.com/large-scale-speedtest-experimentation-in- mobile-broadband-networks/. [Online; accessed 24-Jul-2020].

[23]

Cise Midoglu, Leonhard Wimmer, Andra Lutu, Özgü Alay, and Carsten Griwodz. 2018. MONROE-Nettest: A configurable tool for dissecting speed measurements in mobile broadband networks. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 342--347.

[24]

Miguel Peón-Quirós, Vincenzo Mancuso, Vincenzo Comite, Andra Lutu, Özgü Alay, Stefan Alfredsson, Jonas Karlsson, Anna Brunstrom, Marco Mellia, Ali Safari Khatouni, and Thomas Hirsch. 2017. Results from Running an Experiment as a Service Platform for Mobile Networks. In Proceedings of the 11th Workshop on Wireless Network Testbeds, Experimental Evaluation & CHaracterization (Snowbird, Utah, USA) (WiNTECH '17). Association for Computing Machinery, New York, NY, USA, 9--16. https://doi.org/10.1145/3131473.3131485

Digital Library

[25]

Mohammad Rajiullah, Andra Lutu, Ali Safari Khatouni, Mah-Rukh Fida, Marco Mellia, Anna Brunstrom, Ozgu Alay, Stefan Alfredsson, and Vincenzo Mancuso. 2019. Web Experience in Mobile Networks: Lessons from Two Million Page Visits. In The World Wide Web Conference (San Francisco, CA, USA) (WWW '19). Association for Computing Machinery, New York, NY, USA, 1532--1543. https://doi.org/10.1145/3308558.3313606

Digital Library

[26]

Jingjing Ren, Daniel J. Dubois, David Choffnes, Anna Maria Mandalari, Roman Kolcun, and Hamed Haddadi. 2019. Information Exposure for Consumer IoT Devices: A Multidimensional, Network-Informed Measurement Approach. In Proc. of the Internet Measurement Conference (IMC) .

Digital Library

[27]

Ali Safari Khatouni, Francesca Soro, and Danilo Giordano. 2019. A Machine Learning Application for Latency Prediction in Operational 4G Networks. In 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM). 71--74.

[28]

Arunan Sivanathan, Hassan Habibi Gharakheili, Franco Loi, Adam Radford, Chamith Wijenayake, Arun Vishwanath, and Vijay Sivaraman. 2018. Classifying IoT devices in smart environments using network traffic characteristics. IEEE Transactions on Mobile Computing, Vol. 18, 8 (2018), 1745--1759.

[29]

Srikanth Sundaresan, Walter Donato, Nick Feamster, Renata Teixeira, Sam Crawford, and Antonio Pescape. 2012. Measuring Home Broadband Performance. Commun. ACM, Vol. 55 (11 2012), 100--109. https://doi.org/10.1145/2366316.2366337

Digital Library

[30]

Martino Trevisan, Idilio Drago, Marco Mellia, and Maurizio M. Munafò. 2016. Towards Web Service Classification using Addresses and DNS. In Proceedings of the 7th International Workshop on Traffic Analysis and Characterization (TRAC'16). 38--43. https://ieeexplore.ieee.org/document/7577030/

[31]

Martino Trevisan, Alessandro Finamore, Marco Mellia, Maurizio Munafo, and Dario Rossi. 2017. Traffic analysis with off-the-shelf hardware: Challenges and lessons learned. IEEE Communications Magazine, Vol. 55, 3 (2017), 163--169.

Digital Library

[32]

Martino Trevisan, Danilo Giordano, Idilio Drago, Maurizio Munafò, and Marco Mellia. 2020. Five Years at the Edge: Watching Internet From the ISP Network. IEEE/ACM Transactions on Networking, Vol. 28, 2 (2020), 561--574.

Digital Library

[33]

Martino Trevisan, Ali Safari Khatouni, and Danilo Giordano. 2020. ERRANT: Realistic emulation of radio access networks. Computer Networks, Vol. 176 (2020), 107289. https://doi.org/10.1016/j.comnet.2020.107289

Cited By

Chen DXu WWang HQi YLi RZhou PGuo S(2024)Caching User-Generated Content in Distributed Autonomous Networks via Contextual BanditIEEE Transactions on Mobile Computing10.1109/TMC.2024.334984923:8(8355-8369)Online publication date: Aug-2024
https://doi.org/10.1109/TMC.2024.3349849
Dai HWu JWang YYen JZhang YXu C(2023)Cost-Efficient Sharing Algorithms for DNN Model Serving in Mobile Edge NetworksIEEE Transactions on Services Computing10.1109/TSC.2023.324704916:4(2517-2531)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TSC.2023.3247049
Krämer ZNémeth FMihály AMolnár SPelle IPongrácz GScharnitzky D(2022)On the Potential of MP-QUIC as Transport Layer Aggregator for Multiple Cellular NetworksElectronics10.3390/electronics1109149211:9(1492)Online publication date: 6-May-2022
https://doi.org/10.3390/electronics11091492

Index Terms

An Open Dataset of Operational Mobile Networks
1. Networks

Recommendations

Mobile hosts in enterprise service integration

Mobile data services in combination with profluent web services are seemingly the path-breaking domain in current information systems research. In the Mobile Web Service (MWS) sphere, resource-constrained mobile terminals are used as both web service ...
Understanding Privacy Risks and Perceived Benefits in Open Dataset Collection for Mobile Affective Computing

Collecting large-scale mobile and wearable sensor datasets from daily contexts is essential in developing machine learning models for enabling everyday affective computing applications. However, there is a lack of knowledge on data contributors' ...
An efficient service composition using frequent service sequence patterns over extended web service architecture

In the current business scenario business processes are realised using a stack of simple services selected from service repository to satisfy the business requirement of an enterprise or organisation. The service composition methodologies in common ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobiWac '20: Proceedings of the 18th ACM Symposium on Mobility Management and Wireless Access

November 2020

148 pages

ISBN:9781450381192

DOI:10.1145/3416012

General Chair:
Frank Y. Li
University of Agder, Norway
,
Program Chairs:
Albert Zomaya
The University of Sydney, Australia
,
Rodolfo W. L. Coutinho
The University of Sydney, Australia

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

the SmartData@PoliTO center
MONROE Alliance
Region V\armland via the DigitalWell Arena project

Conference

MSWiM '20

Sponsor:

SIGSIM

MSWiM '20: 23rd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems

November 16 - 20, 2020

Alicante, Spain

Acceptance Rates

Overall Acceptance Rate 83 of 272 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
275
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen DXu WWang HQi YLi RZhou PGuo S(2024)Caching User-Generated Content in Distributed Autonomous Networks via Contextual BanditIEEE Transactions on Mobile Computing10.1109/TMC.2024.334984923:8(8355-8369)Online publication date: Aug-2024
https://doi.org/10.1109/TMC.2024.3349849
Dai HWu JWang YYen JZhang YXu C(2023)Cost-Efficient Sharing Algorithms for DNN Model Serving in Mobile Edge NetworksIEEE Transactions on Services Computing10.1109/TSC.2023.324704916:4(2517-2531)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TSC.2023.3247049
Krämer ZNémeth FMihály AMolnár SPelle IPongrácz GScharnitzky D(2022)On the Potential of MP-QUIC as Transport Layer Aggregator for Multiple Cellular NetworksElectronics10.3390/electronics1109149211:9(1492)Online publication date: 6-May-2022
https://doi.org/10.3390/electronics11091492

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents