Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3671016.3674811acmconferencesArticle/Chapter ViewAbstractPublication PagesinternetwareConference Proceedingsconference-collections
research-article

Energy-Aware Satellite-Ground Co-Inference via Layer-Wise Processing Schedule Optimization

Published: 24 July 2024 Publication History

Abstract

Recent advancements in Low Earth Orbit (LEO) satellites are facilitating the provision of Deep Neural Networks (DNNs)-inherent services to achieve ubiquitous coverage via satellite computing. However, the computational demands and energy consumption of DNN models pose significant challenges for satellite computing with limited power and computation resources. Based on the hierarchical characteristics of DNN models, we propose a satellite-ground co-inference strategy that executing certain layers on satellites and the remaining layers on ground servers. However, identifying the optimal layers for in-orbit processing with latency constraints is challenging due to the uncertain energy consumption across diverse models. To explore the correlation between energy consumption and layer types, we conduct comprehensive measurements on a hardware device commonly found in commercial LEO satellites and develop a layer-based energy consumption prediction model. Then, we formulate an optimization problem of minimizing the energy consumption on the satellite within the latency constraint as an integer nonlinear programming problem. Solving this problem is difficult due to combinatorial explosion in the discrete solution space. To address this, we propose an improved algorithm based on genetic algorithms. Using configurations from a real satellite, we conduct simulation experiments, concluding that our algorithm significantly improves energy savings by an average of 27 ×.

References

[1]
Patrick Bernard and Michael Lippert. 2015. Nickel–cadmium and nickel–metal hydride battery energy storage. Electrochemical energy storage for renewable sources and grid balancing (2015), 223–251.
[2]
Debopam Bhattacherjee, Simon Kassing, Melissa Licciardello, and Ankit Singla. 2020. In-orbit computing: An outlandish thought experiment?Proceedings of the 19th ACM Workshop on Hot Topics in Networks (2020), 197–204.
[3]
Teresa M Braun. 2012. Satellite Communications payload and system. (2012).
[4]
Qi Chen, Zhigang Liu, Xiaofeng Zhang, and Liying Zhu. 2020. Spacecraft Power System Technologies.
[5]
Yijie Chen, Qiyang Zhang, Yiran Zhang, Xiao Ma, and Ao Zhou. 2023. Energy and Time-Aware Inference Offloading for DNN-based Applications in LEO Satellites. 2023 IEEE 31st International Conference on Network Protocols (ICNP) (2023), 1–6.
[6]
Inigo Del Portillo, Bruce G Cameron, and Edward F Crawley. 2019. A technical comparison of three low earth orbit satellite constellation systems to provide global broadband. Acta astronautica 159 (2019), 123–135.
[7]
Bradley Denby, Krishna Chintalapudi, Ranveer Chandra, Brandon Lucia, and Shadi Noghabi. 2023. Kodan: Addressing the computational bottleneck in space. Proceedings of the 28th International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3 (2023), 392–403.
[8]
Bradley Denby and Brandon Lucia. 2019. Orbital edge computing: Machine inference in space. IEEE Computer Architecture Letters 18, 1 (2019), 59–62.
[9]
Bradley Denby and Brandon Lucia. 2020. Orbital edge computing: Nanosatellite constellations as a new class of computer system. Proceedings of the 25th International Conference on Architectural Support for Programming Languages and Operating Systems (2020), 939–954.
[10]
Daniel Fischer, David Basin, Knut Eckstein, and Thomas Engel. 2012. Predictable mobile routing for spacecraft networks. IEEE Transactions on Mobile Computing 12, 6 (2012), 1174–1187.
[11]
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017).
[12]
Chuang Hu, Wei Bao, Dan Wang, and Fengming Liu. 2019. Dynamic adaptive DNN surgery for inference acceleration on the edge. IEEE INFOCOM 2019-IEEE Conference on Computer Communications (2019), 1423–1431.
[13]
Hyuk-Jin Jeong, Hyeon-Jae Lee, Chang Hyun Shin, and Soo-Mook Moon. 2018. IONN: Incremental offloading of neural network computations from mobile devices to edge servers. Proceedings of the ACM symposium on cloud computing (2018), 401–411.
[14]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012).
[15]
Zeqi Lai, Hewu Li, Qian Wu, Qiang Ni, Mingyang Lv, Jihao Li, Jianping Wu, Jun Liu, and Yuanjie Li. 2022. Futuristic 6G pervasive on-demand services: Integrating space edge computing with terrestrial networks. IEEE Vehicular Technology Magazine 18, 1 (2022), 80–90.
[16]
Qing Li, Shangguang Wang, Xiao Ma, Ao Zhou, and Fangchun Yang. 2021. Towards Sustainable Satellite Edge Computing. 2021 IEEE International Conference on Edge Computing (EDGE) (2021), 1–8.
[17]
Yuanjie Li, Hewu Li, Wei Liu, Lixin Liu, Wei Zhao, Yimei Chen, Jianping Wu, Qian Wu, Jun Liu, Zeqi Lai, 2023. A networking perspective on starlink’s self-driving leo mega-constellation. Proceedings of the 29th Annual International Conference on Mobile Computing and Networking (2023), 1–16.
[18]
Huanghuang Liang, Qianlong Sang, Chuang Hu, Dazhao Cheng, Xiaobo Zhou, Dan Wang, Wei Bao, and Yu Wang. 2023. DNN surgery: Accelerating DNN inference on the edge through layer partitioning. IEEE transactions on Cloud Computing (2023).
[19]
Timothy M Lim, Aaron M Cramer, James E Lumpp, and Samir A Rawashdeh. 2018. A modular electrical power system architecture for small spacecraft. IEEE Trans. Aerospace Electron. Systems 54, 4 (2018), 1832–1849.
[20]
Wenyu Liu, Gaofeng Ren, Runsheng Yu, Shi Guo, Jianke Zhu, and Lei Zhang. 2022. Image-adaptive YOLO for object detection in adverse weather conditions. Proceedings of the AAAI Conference on Artificial Intelligence 36, 2 (2022), 1792–1800.
[21]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
[22]
Pedro Pereira, Bruno J Guerreiro, and Pedro Lourenço. 2022. Distributed model predictive control method for spacecraft formation flying in a leader-follower formation. IEEE Trans. Aerospace Electron. Systems (2022).
[23]
Jaan Praks, M Rizwan Mughal, R Vainio, P Janhunen, J Envall, P Oleynik, Antti Näsilä, H Leppinen, P Niemelä, A Slavinskis, 2021. Aalto-1, multi-payload CubeSat: Design, integration and launch. Acta Astronautica 187 (2021), 370–383.
[24]
HS Rauschenbach. 2012. Solar cell array design handbook: The principles and technology of photovoltaic energy conversion. NASA STI/Recon Technical Report A 80 (2012), 34847.
[25]
Ergys Ristani and Carlo Tomasi. 2018. Features for multi-target multi-camera tracking and re-identification. Proceedings of the IEEE conference on computer vision and pattern recognition (2018), 6036–6046.
[26]
Crefeda Faviola Rodrigues, Graham Riley, and Mikel Luján. 2018. SyNERGY: An energy measurement and prediction framework for Convolutional Neural Networks on Jetson TX1. Proceedings of the international conference on parallel and distributed processing techniques and applications (PDPTA) (2018), 375–382.
[27]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[28]
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition, 1–9.
[29]
Weichi Tan, Jingang Hu, 2009. Spacecraft Systems Engineering. (2009).
[30]
Xiaolong Tu, Anik Mallik, Dawei Chen, Kyungtae Han, Onur Altintas, Haoxin Wang, and Jiang Xie. 2023. Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices. 2023 IEEE/ACM Symposium on Edge Computing (SEC), 80–93.
[31]
Ruolin Xing, Mengwei Xu, Ao Zhou, Qing Li, Yiran Zhang, Feng Qian, and Shangguang Wang. 2024. Deciphering the enigma of satellite computing with cots devices: Measurement and analysis. Proceedings of the 30th Annual International Conference on Mobile Computing and Networking (2024).
[32]
Zichuan Xu, Liqian Zhao, Weifa Liang, Omer F Rana, Pan Zhou, Qiufen Xia, Wenzheng Xu, and Guowei Wu. 2020. Energy-aware inference offloading for DNN-driven applications in mobile edge clouds. IEEE Transactions on Parallel and Distributed Systems 32, 4 (2020), 799–814.
[33]
Yuan Yang, Mingwei Xu, Dan Wang, and Yu Wang. 2016. Towards energy-efficient routing in satellite networks. IEEE Journal on Selected Areas in Communications 34, 12 (2016), 3869–3886.
[34]
Rongjie Yi, Ting Cao, Ao Zhou, Xiao Ma, Shangguang Wang, and Mengwei Xu. 2023. Boosting DNN Cold Inference on Devices. The 21st International Conference on Mobile Systems, Applications, and Services (2023).
[35]
Kegen Yu, Yunwei Li, and Xin Chang. 2018. Snow depth estimation based on combination of pseudorange and carrier phase of GNSS dual-frequency signals. IEEE Transactions on Geoscience and Remote Sensing 57, 3 (2018), 1817–1828.
[36]
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, and Yunxin Liu. 2021. Nn-meter: Towards accurate latency prediction of deep-learning model inference on diverse edge devices. Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services (2021), 81–93.
[37]
Qiyang Zhang, Xiangying Che, Yijie Chen, Xiao Ma, Mengwei Xu, Schahram Dustdar, Xuanzhe Liu, and Shangguang Wang. 2023. A Comprehensive Deep Learning Library Benchmark and Optimal Library Selection. IEEE Transactions on Mobile Computing (2023).
[38]
Qiyang Zhang, Xiang Li, Xiangying Che, Xiao Ma, Ao Zhou, Mengwei Xu, Shangguang Wang, Yun Ma, and Xuanzhe Liu. 2022. A comprehensive benchmark of deep learning libraries on mobile devices. Proceedings of the ACM Web Conference 2022 (2022), 3298–3307.
[39]
Qiyang Zhang, Xin Yuan, Ruolin Xing, Yiran Zhang, Zimu Zheng, Xiao Ma, Mengwei Xu, Schahram Dustdar, and Shangguang Wang. 2024. Resource-efficient In-orbit Detection of Earth Objects. IEEE INFOCOM 2024-IEEE conference on computer communications (2024).
[40]
Tongxin Zhu, Jianzhong Li, Zhipeng Cai, Yingshu Li, and Hong Gao. 2020. Computation scheduling for wireless powered mobile edge computing networks. IEEE INFOCOM 2020-IEEE Conference on Computer Communications (2020), 596–605.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Internetware '24: Proceedings of the 15th Asia-Pacific Symposium on Internetware
July 2024
518 pages
ISBN:9798400707056
DOI:10.1145/3671016
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Deep Neural Networks
  2. LEO satellite
  3. energy prediction
  4. satellite computing
  5. satellite-ground co-inference

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

Internetware 2024
Sponsor:

Acceptance Rates

Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 91
    Total Downloads
  • Downloads (Last 12 months)91
  • Downloads (Last 6 weeks)23
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media