Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A privacy protection approach in edge-computing based on maximized dnn partition strategy with energy saving

Published: 03 March 2023 Publication History

Abstract

With the development of deep neural network (DNN) techniques, applications of DNNs show state-of-art performance. In the cloud edge collaborative mode, edge devices upload the raw data, such as texts, images, and videos, to the cloud for processing. Then, the cloud returns prediction or classification results. Although edge devices take advantage of the powerful performance of DNN, there are also colossal privacy protection risks. DNN partition strategy can effectively solve the privacy problems by offload part of the DNN model to the edge, in which the encoded features are transmitted rather than original data. We explore the relationship between privacy and the intermedia result of the DNN. The more parts offloaded to the edge, the more abstract features we can have, indicating more conducive to privacy protection. We propose a privacy protection approach based on a maximum DNN partition strategy. Besides, a mix-precision quantization approach is adopted to reduce the energy use of edge devices. The experiments show that our method manages to increase at most 20% model privacy in various DNN architecture. Through the energy-aware mixed-precision quantization approach, the model’s energy consumption is reduced by at most 5x comparing to the typical edge-cloud solution.

References

[1]
Kumar N, Kaur N, and Gupta D Dutta M, Krishna CR, Kumar R, and Kalra M Major Convolutional Neural Networks in Image Classification: A Survey International Conference on IoT Inclusive Life 2019 India NITTTR Chandigarh 243-258
[2]
Liu L, Ouyang W, Wang X, Fieguth P, Chen J, Liu X, and Pietikäinen M Deep Learning for Generic Object Detection: A Survey Int J Comput Vis 2020 128 2 261-318
[3]
Otter DW, Medina JR, and Kalita JK A Survey of the Usages of Deep Learning for Natural Language Processing IEEE Trans Neural Netw Learn Syst 2021 32 2 604-624
[4]
Miao W, Zeng Z, Wei L, Li S, Jiang C, and Zhang Z Adaptive DNN Partition in Edge Computing Environments IEEE International Conference on Parallel and Distributed Systems 2020 Hong Kong, China IEEE 685-690
[5]
Lecun Y and Bottou L Gradient-based learning applied to document recognition Proc IEEE 1998 86 11 2278-2324
[6]
Goldstein BF, Patil VC, Ferreira VC, Nery AS, França FMG, and Kundu S Preventing dnn model ip theft via hardware obfuscation IEEE J Emerg Sel Top Circ Syst 2021 11 2 267-277
[7]
Gu Z, Huang H, Zhang J, Su D, Jamjoom H, Lamba A, Pendarakis D, Molloy I (2020) Confidential Inference via Ternary Model Partitioning. arXiv preprint arXiv:1807.00969
[8]
Blalock DW, Ortiz JJG, Frankle J, Guttag JV (2020) What is the state of neural network pruning? In: Dhillon IS, Papailiopoulos DS, Sze V (eds) Proceedings of Machine Learning and Systems, PMLR, Austin, Texas, pp 129–146
[9]
Tonellotto N, Gotta A, Nardini FM, Gadler D, and Silvestri F Neural network quantization in federated learning at the edge Inf Sci 2021 575 417-436
[10]
Wang X, Che M, and Wei Y Tensor neural network models for tensor singular value decompositions Comput Optim Appl 2020 75 3 753-777
[11]
Gou J, Yu B, Maybank SJ, and Tao D Knowledge Distillation: A Survey Int J Comput Vis 2021 129 6 1789-1819
[12]
Wang K, Liu Z, Lin Y, Lin J, and Han S HAQ: Hardware-Aware Automated Quantization With Mixed Precision Conference on Computer Vision and Pattern Recognition 2019 Long Beach, California IEEE 8604-8612
[13]
Mao J, Chen X, Nixon KW, Krieger C, Chen Y (2017) MoDNN: Local distributed mobile computing system for Deep Neural Network. In: Design, Automation Test in Europe Conference Exhibition (DATE), IEEE, Lausanne, Switzerland, pp 1396–1401
[14]
Zhao Z, Barijough KM, and Gerstlauer A DeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters IEEE Trans Comput-Aided Des Integr Circ Syst 2018 37 11 2348-2359
[15]
Kang Y, Hauswald J, Gao C, Rovinski A, Mudge T, Mars J, Tang L (2017) Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge. In: Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems, ACM, Xi’an China, pp 615–629
[16]
Ko JH, Na T, Amir MF, Mukhopadhyay S (2018) Edge-Host Partitioning of Deep Neural Networks with Feature Space Encoding for Resource-Constrained Internet-of-Things Platforms. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, IEEE, pp 1–6
[17]
Li J, Wang X (2018) Research on the Application of Blockchain in the Traceability System of Agricultural Products. In: IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference, IEEE, Xi’an, pp 2637–2640
[18]
Li C, Xu H, Xu Y, Wang Z, Huang L (2021) DNN Inference Acceleration with Partitioning and Early Exiting in Edge Computing. In: Liu Z, Wu F, Das SK (eds) International Conference on Wireless Algorithms, Systems, and Applications vol 12937. Springer, Nanjing, pp 465–478
[19]
Osia SA, Shahin Shamsabadi A, Sajadmanesh S, Taheri A, Katevas K, Rabiee HR, Lane ND, and Haddadi H A Hybrid Deep Learning Architecture for Privacy-Preserving Mobile Analytics IEEE Internet Things J 2020 7 5 4505-4518
[20]
Tang Y, Wang Y, Li H, and Li X To cloud or not to cloud: An on-line scheduler for dynamic privacy-protection of deep learning workload on edge devices CCF Trans High Perform Comput 2021 3 1 85-100
[21]
Shi C, Chen L, Shen C, Song L, and Xu J Privacy-Aware Edge Computing Based on Adaptive DNN Partitioning IEEE Global Communications Conference 2019 Waikoloa, Hawaii IEEE 1-6
[22]
Krishnamoorthi R (2018) Quantizing deep convolutional networks for efficient inference: A whitepaper. arXiv preprint arXiv:1806.08342
[23]
Yuan Y, Chen C, Hu X, and Peng S EvoQ: Mixed Precision Quantization of DNNs via Sensitivity Guided Evolutionary Search 2020 International Joint Conference on Neural Networks (IJCNN) 2020 Glasgow IEEE 1-8
[24]
Rusci M, Capotondi A, Benini L (2020) Memory-Driven Mixed Low Precision Quantization for Enabling Deep Network Inference on Microcontrollers. In: Machine Learning and Systems 2 (MLSys 2020), Austin, TX, USA, p 1-10
[25]
Wang Z, Bovik A, Sheikh H, and Simoncelli E Image Quality Assessment: From Error Visibility to Structural Similarity IEEE Trans Image Process 2004 13 4 600-612
[26]
He K, Zhang X, Ren S, and Sun J Deep residual learning for image recognition IEEE Conference on Computer Vision and Pattern Recognition 2016 Las Vegas, Nevada IEEE 770-778
[27]
Huang G, Liu Z, Van Der Maaten L, and Weinberger KQ Densely Connected Convolutional Networks IEEE Conference on Computer Vision and Pattern Recognition 2017 Honolulu IEEE 2261-2269
[28]
Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR abs/1704.04861:1–9
[29]
Sandler M, Howard A, Zhu M, Zhmoginov A, and Chen LC MobileNetV2: Inverted Residuals and Linear Bottlenecks 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018 Salt Lake City, UT IEEE 4510-4520
[30]
Jacob B, Kligys S, Chen B, Zhu M, Tang M, Howard A, Adam H, and Kalenichenko D Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition 2018 Salt Lake City IEEE 2704-2713
[31]
Panda P (2020) QUANOS: Adversarial noise sensitivity driven hybrid quantization of neural networks. In: Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design, ACM, Boston Massachusetts, pp 187–192

Cited By

View all
  • (2023)HVS-inspired adversarial image generation with high perceptual qualityJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-023-00470-212:1Online publication date: 13-Jun-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal of Cloud Computing: Advances, Systems and Applications
Journal of Cloud Computing: Advances, Systems and Applications  Volume 12, Issue 1
Dec 2023
2838 pages
ISSN:2192-113X
EISSN:2192-113X
Issue’s Table of Contents

Publisher

Hindawi Limited

London, United Kingdom

Publication History

Published: 03 March 2023
Accepted: 08 February 2023
Received: 16 October 2021

Author Tags

  1. Privacy protection
  2. Edge-intelligent
  3. DNN partition
  4. Mixed-precision quantization
  5. Energy optimization

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 02 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)HVS-inspired adversarial image generation with high perceptual qualityJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-023-00470-212:1Online publication date: 13-Jun-2023

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media