research-article

Network and Application Performance Measurement Challenges on Android Devices

Authors:

Mohammad A. Hoque,

Sasu TarkomaAuthors Info & Claims

ACM SIGMETRICS Performance Evaluation Review, Volume 48, Issue 3

Pages 6 - 11

https://doi.org/10.1145/3453953.3453955

Published: 05 March 2021 Publication History

Abstract

Modern mobile systems are optimized for energy-efficient computation and communications, and these optimizations affect the way they use the network, and thus the performance of the applications. Therefore, understanding network and application performance are essential for debugging, improving user experience, and performance comparison. In recent years, several tools have emerged that analyze network performance of mobile applications in situ with the help of the VPN service. However, there is a limited understanding of how these measurement tools and system optimizations affect the network and application performance. This paper first demonstrates that mobile systems employ energy-aware system hardware tuning, affecting network latency and throughput. We next show that the VPN-based tools, such as Lumen, PrivacyGuard, and Video Optimizer, aid in ambiguous network performance measurements and degrade the application performance. Our findings suggest that sound Internet traffic measurement on Android devices requires a good understanding of the device, networks, measurement tools, and applications.

References

[1]

SPEEDCHECK - Speed Test. https://play.google.com/store/apps/details?id=org. speedspot.speedanalytics. [Online; accessed 7-August-2019].

[2]

Speedtest by Ookla. https://play.google.com/store/apps/details?id=org.zwanoo. android.speedtest.gworld. [Online; accessed 11-August-2019].

[3]

VPN - Android Developers. https://developer.android.com/guide/topics/ connectivity/vpn. [Online; accessed 23-January-2019].

[4]

4 cores always stopped, what's going on? https://forum.xda-developers.com/ nexus-6p/help/4-cores-allways-stopped-whats-t3390543, 2016. [Online; accessed 15-March-2020].

[5]

Low Battery Disabling CPU Cores. https://www.reddit.com/r/nexus6/comments/ 4k4ut1/low_battery_disabling_cpu_cores/, 2016. [Online; accessed 7-May-2020].

[6]

AT&T Video Optimizer. https://developer.att.com/video-optimizer, 2019.

[7]

Network Signal Guru. https://play.google.com/store/apps/details?id=com.qtrun. QuickTest, 2019.

[8]

Mario Almeida, Alessandro Finamore, Diego Perino, Narseo Vallina-Rodriguez, and Matteo Varvello. Dissecting DNS Stakeholders in Mobile Networks. In Proceedings of CoNEXT '17, pages 28--34. ACM, 2017.

[9]

Apple. iPhone Battery and Performance. https://support.apple.com/en-us/ HT208387, 2020. [Online; accessed 21-July-2029].

[10]

Apple. Recording a Packet Trace. https://developer.apple.com/documentation/ network/recording_a_packet_trace, 2020. [Online; accessed 7-April-2020].

[11]

Hossein Falaki, Dimitrios Lymberopoulos, Ratul Mahajan, Srikanth Kandula, and Deborah Estrin. A First Look at Traffic on Smartphones. In Proceedings of IMC '10, pages 281--287. ACM, 2010.

Digital Library

[12]

Mohammad A. Hoque, Petteri Nurmi, Matti Siekkinen, Pan Hui, and Sasu Tarkoma. The Bits of Silence: Redundant Traffic in VoIP. In Proceedings of the 11th ACM Multimedia Systems Conference, MMSys '20, page 1--14, New York, NY, USA, 2020. Association for Computing Machinery.

[13]

Mohammad Ashraful Hoque, Matti Siekkinen, Jukka K. Nurminen, Mika Aalto, and Sasu Tarkoma. Mobile multimedia streaming techniques: QoE and energy saving perspective. Pervasive and Mobile Computing, 16:96 -- 114, 2015.

[14]

Junxian Huang, Feng Qian, Z. Morley Mao, Subhabrata Sen, and Oliver Spatscheck. Screen-off Traffic Characterization and Optimization in 3G/4G Networks. In Proceedings of IMC '12, pages 357--364. ACM, 2012.

Digital Library

[15]

Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando A. Kuipers, and Gil Zussman. Performance evaluation of webrtc-based video conferencing. SIGMETRICS Performance Evaluation Review, 45:56--68, 2017.

Digital Library

[16]

Feng Li, Jae Won Chung, and Mark Claypool. Silhouette: Identifying youtube video flows from encrypted traffic. In Proceedings of NOSSDAV, pages 19--24. ACM, 2018.

[17]

W. Li, D. Wu, R. K. C. Chang, and R. K. P. Mok. Toward accurate network delay measurement on android phones. IEEE Transactions on Mobile Computing, 17(3):717--732, 2018.

[18]

Weichao Li, Daoyuan Wu, Rocky K.C. Chang, and Ricky K.P. Mok. Demystifying and puncturing the in?ated delay in smartphone-based wifi network measurement. In Proceedings of the 12th International on Conference on Emerging Networking EXperiments and Technologies, CoNEXT '16, page 497--504, New York, NY, USA, 2016. Association for Computing Machinery.

Digital Library

[19]

Y. Liu, F. Li, L. Guo, B. Shen, and S. Chen. Effectively minimizing redundant internet streaming traffic to ios devices. In 2013 Proceedings IEEE INFOCOM, pages 250--254, 2013.

[20]

F. Michclinakis, H. Doroud, A. Razaghpanah, A. Lutu, N. Vallina-Rodriguez, P. Gill, and J. Widmer. The Cloud that Runs the Mobile Internet: A Measurement Study of Mobile Cloud Services. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, pages 1619--1627, April 2018.

[21]

Tanuj Mittal, Lokesh Singhal, and Divyashikha Sethia. Optimized cpu frequency scaling on android devices based on foreground running application. Lecture Notes in Electrical Engineering, 131:827--834, 01 2013.

[22]

Vern Paxson. Strategies for sound internet measurement. In Proceedings of IMC, IMC '04, page 263--271. ACM, 2004.

Digital Library

[23]

Feng Qian, Zhaoguang Wang, Alexandre Gerber, Zhuoqing Mao, Subhabrata Sen, and Oliver Spatscheck. Profiling Resource Usage for Mobile Applications: A Cross-layer Approach. In Proceedings of MobiSys'11, pages 321--334. ACM, 2011.

[24]

K. Rao, J. Wang, S. Yalamanchili, Y. Wardi, and H. Ye. Application-Specific Performance-Aware Energy Optimization on Android Mobile Devices. In Proceedings of HPCA, pages 169--180, 2017.

[25]

Abbas Razaghpanah, Arian Akhavan Niaki, Narseo Vallina-Rodriguez, Srikanth Sundaresan, Johanna Amann, and Phillipa Gill. Studying TLS Usage in Android Apps. In Proceedings of CoNEXT '17, pages 350--362. ACM, 2017.

[26]

Andrew Reed and Michael Kranch. Identifying HTTPS-Protected Netflix Videos in Real-Time. In Proceedings of CODASPY, pages 361--368. ACM, 2017.

[27]

Yihang Song and Urs Hengartner. PrivacyGuard: A VPN-based Platform to Detect Information Leakage on Android Devices. In Proceedings of SPSM, pages 15--26. ACM, 2015.

Digital Library

[28]

Y. Sun, L. Kong, H. Abbas Khan, and M. G. Pecht. Li-ion battery reliability -- a case study of the apple iphone®. IEEE Access, 7:71131--71141, 2019.

[29]

Tavish Vaidya, Tim Walsh, and Micah Sherr. Whisper: A Unilateral Defense Against VoIP Traffic Re-identification Attacks. In Proceedings of ACSAC, pages 286--296. ACM, 2019.

[30]

Daoyuan Wu, Rocky K. C. Chang, Weichao Li, Eric K. T. Cheng, and Debin Gao. MopEye: Opportunistic Monitoring of Per-app Mobile Network Performance. In Proceedings of USENIX ATC '17, pages 445--457. USENIX Association, 2017.

Cited By

Manas Kala SMishra MBiju ASathya VAmano THigashino TYamaguchi HReddy Tamma B(2024)Architecture, Performance, and Usability of Mobile Cellular Network Monitoring Applications for Data-Driven AnalysisIEEE Access10.1109/ACCESS.2024.341275212(88426-88444)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3412752
Jing PAn NYue S(2023)Dynamic detection method for Android terminal malware based on Native layer2023 4th International Conference on Computer Engineering and Application (ICCEA)10.1109/ICCEA58433.2023.10135186(83-86)Online publication date: 7-Apr-2023
https://doi.org/10.1109/ICCEA58433.2023.10135186
Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2023)Context-driven encrypted multimedia traffic classification on mobile devicesPervasive and Mobile Computing10.1016/j.pmcj.2022.10173788:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.pmcj.2022.101737
Show More Cited By

Index Terms

Network and Application Performance Measurement Challenges on Android Devices
1. General and reference
  1. Cross-computing tools and techniques
    1. Measurement
    2. Performance
2. Networks
  1. Network performance evaluation

Index terms have been assigned to the content through auto-classification.

Recommendations

Application level measurement
Network performance engineering

In some cases, application-level measurements can be the only way for an application to get an understanding about the performance offered by the underlying network(s). It can also be that an application-level measurement is the only practical solution ...
Monitoring mobile video delivery to Android devices
MMSys '13: Proceedings of the 4th ACM Multimedia Systems Conference

The proliferation of smart devices for mobile networks is a major traffic generator nowadays. These devices provide the ability to receive media content in nearly every situation. Despite that video streaming in high quality is getting more and more ...
Android on Mobile Devices: An Energy Perspective
CIT '10: Proceedings of the 2010 10th IEEE International Conference on Computer and Information Technology

Mobile devices and embedded devices need more processing power but energy consumption should be less to save battery power. Open Handset Alliance (OHA) hosting members like Google, Motorola, HTC etc released an open source platform Android for mobile ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMETRICS Performance Evaluation Review

ACM SIGMETRICS Performance Evaluation Review Volume 48, Issue 3

December 2020

140 pages

ISSN:0163-5999

DOI:10.1145/3453953

Editor:
Zhenhua Liu
Stony Brook University

Issue’s Table of Contents

Copyright © 2021 Copyright is held by the owner/author(s).

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2021

Published in SIGMETRICS Volume 48, Issue 3

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
103
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Manas Kala SMishra MBiju ASathya VAmano THigashino TYamaguchi HReddy Tamma B(2024)Architecture, Performance, and Usability of Mobile Cellular Network Monitoring Applications for Data-Driven AnalysisIEEE Access10.1109/ACCESS.2024.341275212(88426-88444)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3412752
Jing PAn NYue S(2023)Dynamic detection method for Android terminal malware based on Native layer2023 4th International Conference on Computer Engineering and Application (ICCEA)10.1109/ICCEA58433.2023.10135186(83-86)Online publication date: 7-Apr-2023
https://doi.org/10.1109/ICCEA58433.2023.10135186
Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2023)Context-driven encrypted multimedia traffic classification on mobile devicesPervasive and Mobile Computing10.1016/j.pmcj.2022.10173788:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.pmcj.2022.101737
Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2022)Context-driven Encrypted Multimedia Traffic Classification on Mobile Devices2022 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom53586.2022.9762389(54-64)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerCom53586.2022.9762389
Rao AKirkko-Jaakkola MRuotsalainen L(2021)Dissemination of GNSS RTK using MQTT2021 Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit)10.1109/EuCNC/6GSummit51104.2021.9482565(282-287)Online publication date: 8-Jun-2021
https://doi.org/10.1109/EuCNC/6GSummit51104.2021.9482565

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents