An offloading method in new energy recharging based on GT-DQN
Pages 479 - 492
Abstract
The utilization of green edge has emerged as a promising paradigm for the development of new energy vehicle (NEV). Nevertheless, the recharging of these vehicles poses a significant challenge in due to limited power resources and enormous transmission demands. A novel architecture based on Wifi-6 communication is proposed, which makes the most of heterogeneous edge nodes to achieve real-time processing and computation of tasks. To address the collaborative power resource optimization problem, the interference between different vehicles is considered, and the task offloading is optimized. In particular, the power contention among recharging clusters is modeled as an exact game and a task offloading strategy model is proposed jointly with the Deep Q-Network (DQN) algorithm, which is employed by a secondary application. Thereby, the recharging efficiency and task offloading computation are optimized and improved. Results indicate that the total resource consumption is favorably improved with this architecture and algorithm and the Nash equilibrium is also demonstrated.
References
[1]
Shan JaffryIntelligent Reflecting Surface Aided Wireless Energy Transfer and Mobile Edge Computing for Public Transport Vehicles[J], ArXiv (2021).
[2]
Yuan Y., Shen Q., Wang S., et al. Coronavirus Mask Protection Algorithm: A New Bio-inspired Optimization Algorithm and Its Applications[J], Journal of Bionic Engineering 20(4) (2023), 1747–1765.
[3]
Chunli Ren, Guoan Zhang, Xiaohui Gu, et al.Computing Offloading in Vehicular Edge Computing Networks: Full or Partial Offloading?[J], 2022 IEEE 6th Information Technology and Mechatronics Engineering Conference (ITOEC) (2022), 693–698.
[4]
Almutairi J., Aldossary M., Alharbi H.A., et al. Delay-optimal taskoffloading for UAV-enabled edge-cloud computing systems[J], IEEE Access 10 (2022), 51575–51586.
[5]
Hazra A., Donta P.K., Amgoth T., et al. Cooperative transmission scheduling and computation offloading with collaboration of fog and cloud for industrial IoT applications[J], IEEE Internet of Things Journal 10 (5) (2022), 3944–3953.
[6]
Zhang D., Cao L., Zhu H., et al. Task offloading method of edge computing in internet of vehicles based on deep reinforcement learning[J], Cluster Computing 25 (2) (2022), 1175–1187.
[7]
Chen Y., Gu W., Xu J., et al.Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning[J], China Communications (2023).
[8]
Tan X., Qu G., Sun B., et al. Optimal scheduling of battery charging station serving electric vehicles based on battery swapping[J], IEEE Transactions on Smart Grid 10 (2) (2017), 1372–1384.
[9]
Liu Y., Xie S., Yang Q., et al. Joint computation offloading anddemand response management in mobile edgenetwork with renewable energy sources[J], IEEE Transactions onVehicular Technology 69 (12) (2020), 15720–15730.
[10]
Zhang P., Chen J., Tu L. and Yin L., Layout Evaluation of New Energy Vehicle Charging Stations: A Perspective Using the Complex Network Robustness Theory, World Electric Vehicle Journal 13(7) (2022), 127.
[11]
Zhang Zheng, Wu Lin, Zeng Feng, Optimal Task Offloading Strategy in Vehicular Edge Computing Based on Game Theory[J], Wireless Algorithms, Systems, and Applications 13473 (2022), 554–562.
[12]
Teymoori P., Boukerche A.Dynamic Multi-user Computation Offloading for Mobile Edge Computing using Game Theory and Deep Reinforcement Learning[A], ICC 2022 –IEEE International Conference on Communications[C] (2022), 1930–1935.
[13]
Zhang D., Cao Lixiang, Zhu H., et al. Task offloading method of edge computing in internet of vehicles based on deep reinforcement learning[J], Cluster Computing 25 (2) (2022), 1175–1187.
[14]
Lixue Gao, Xin Chen, BoYin, et al.Computation Offloading Based on Game Theory in Multi-access Edge Computing for 6G Network[J], 2022 14th International Conference on Communication Software and Networks (ICCSN) (2022), 63–68.
[15]
Cheng Qian, Gansen ZhaoHaoyu LuoGame Theory based D2D Collaborative Offloading for Workflow Applications in Mobile Edge Computing[J], 2022 IEEE International Conference on Web Services (ICWS) (2022), 276–285.
[16]
Hassan Khoobkar Mohammad, Dehghan Takht Fooladi Mehdi, Rezvani M.H., et al.Partial offloading with stable equilibrium in fog-cloud environments using replicator dynamics of evolutionary game theory[J], Cluster Computing 25 (2) (2022), 1393–1420.
[17]
Zhiyong Luo, Ao HuangJoint Game Theory and Greedy Optimization Scheme of Computation Offloading for UAV-Aided Network[J], International Telecommunication Networks and Applications Conference (2021), 198–203.
[18]
Chakraborty S. and Mazumdar K., Sustainable task offloading decision using genetic algorithm in sensor mobile edge computing[J], Journal of King Saud University-Computer and Information Sciences 34 (4) (2022), 1552–1568.
[19]
Abu-Taleb N.A., Abdulrazzak F.H., Zahary A.T., et al.Offloading decision making in mobile edge computing: A survey[C]//2022 2nd International Conference on Emerging Smart Technologies and Applications (eSmarTA). IEEE (2022), 1–8.
[20]
Tong M., Wang X., Li S., et al. Joint Offloading Decision and Resource Allocation in Mobile Edge Computing-Enabled Satellite-Terrestrial Network[J], Symmetry 14 (3) (2022), 564.
[21]
Li Y., Yang B., Wu H., et al. Joint offloading decision and resource allocation for vehicular fog-edge computing networks: A contract-stackelberg approach[J], IEEE Internet of Things Journal 9 (17) (2022), 15969–15982.
[22]
Ren J., Wang Z., Pang Y., et al. Genetic algorithm-assisted an improved AdaBoost double-layer for oil temperature prediction of TBM[J], Advanced Engineering Informatics 52 (2022), 101563.
[23]
Fan W., Han J., Yao L., et al. Latency-energy optimization for joint WiFi and cellular offloading in mobile edge computing networks[J], Computer Networks 181 (2020), 107570.
[24]
Islam G.Z. and Kashem M.A., A proportional scheduling protocol for the ofdma-based future wi-fi network[J], J. Commun 17 (2022), 322–338.
[25]
Suer M.T., Jose P., Tchouankem H.Experimental evaluation of IEEE 802.11 ax-low latency and high reliability with Wi-Fi 6? [C]//GLOBECOM 2022-2022 IEEE Global Communications Conference. IEEE (2022), 377–382.
[26]
Behara A. and Venkatesh T.G., Fluid-limit model for dynamic MU-OFDMA resource allocation of Wi-Fi6 networks[J], IEEE Communications Letters 26 (1) (2021), 207–211.
[27]
Jiang Chunmao, Liu Yue, Energy-saving Offloading Strategies for Sensor Tasks Based on Three-way Game Theory in Wireless Communications[J], Ad Hoc Sens. Wirel. Networks 51 (2022), 1–22.
[28]
Wu L., Liu Zening and Sun P., DOT: Decentralized Offloading of Tasks in OFDMA based Heterogeneous Computing Networks[J], IEEE Internet of Things Journal 9 (20) (2022), 20071–20082.
[29]
Wu Di., Wu Di, Lei Yin., et al. Deep Reinforcement Learning-Based Path Control and Optimization for Unmanned Ships[J], Wireless Communications and Mobile Computing 2022 (2022), 1–8.
[30]
Hossain Md.Delowar, Sultana Tangina, ur Rahman Waqas, et al. Game Theory Based Dynamic Computation Offloading in MEC-Enabled Vehicular Networks[J], Jeongbogwahakoe keompyuting-ui silje nonmunji 28 (4) (2022), 216–224.
[31]
Saurabh Nimkar Khanapurkar M., Design of a Qlearning based Smart Grid and smart Water scheduling model based on Heterogeneous Task Specific Offloading process[J], 2022 International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON) (2022), 1–9.
[32]
Xu X., Shen B., Ding S., et al. Service Offloading With Deep Q-Network for Digital Twinning-Empowered Internet of Vehicles in Edge Computing[J], IEEE Transactions on Industrial Informatics 18 (2) (2022), 1414–1423.
[33]
Cai J., Hongtian Fu., Liu Y., et al.Deep reinforcement learning-based multitask hybrid computing offloading for multiaccess edge computing[J], International Journal of Intelligent Systems (2022).
[34]
Agrawal N., Bansal A., Singh K., et al. Performance evaluation ofRIS-assisted UAV-enabled vehicular communication system withmultiple non-identical interferers[J], IEEE Transactions onIntelligent Transportation Systems 23 (7) (2021), 9883–9894.
[35]
Sadatdiynov K., Cui L., Zhang L., et al.A review of optimization methods for computation offloading in edge computing networks[J], Digital Communications and Networks (2022).
[36]
Xu J., Li D., Gu W., et al. UAV-assisted task offloading for IoT in smart buildings and environment via deep reinforcement learning[J], Building and Environment 222 (2022), 109218.
[37]
Zabihi Z. and Eftekhari A.M., Moghadam and M.H. Rezvani, Reinforcement Learning Methods for Computation Offloading: A Systematic Review[J], ACM Computing Surveys 56 (1) (2023), 1–41.
[38]
Seid A.M., Lu J., Abishu H.N., et al. Blockchain-Enabled Task Offloading With Energy Harvesting in Multi-UAV-Assisted IoT Networks: A Multi-Agent DRL Approach[J], IEEE Journal on Selected Areas in Communications 40 (12) (2022), 3517–3532.
[39]
Zhang D.G., Dong W.M., Zhang T., et al.New computing tasks offloading method for mec based on prospect theory framework[J], IEEE Transactions on Computational Social Systems (2022).
[40]
Mitsis G., Tsiropoulou E.E. and Papavassiliou S., Data offloading in UAV-assisted multi-access edge computing systems: A resource-based pricing and user risk-awareness approach[J], Sensors 20(8) (2022), 2434.
Recommendations
Community Energy Management with Electric Vehicles for Effective Use of Solar Energy
ICAIET '14: Proceedings of the 2014 4th International Conference on Artificial Intelligence with Applications in Engineering and TechnologyPhotovoltaic generation (PV) output varies depending on the time, weather, and season. In these days, batteries equipped in electric vehicles (EVs) can be utilized as substitutes for the storage systems, and are expected to use output of PV generation ...
Intelligent task prediction and computation offloading based on mobile-edge cloud computing
AbstractEdge computing overcomes the high communication delay shortcoming of traditional cloud computing and provides computing services with high reliability and high bandwidth for mobile devices. At present, edge computing has become the ...
Highlights- The paper designs an intelligent computation offloading based MEC architecture.
Task offloading in vehicular fog computing: State-of-the-art and open issues
AbstractVehicular fog computing (VFC) has been proposed as a promising solution to overcome the limitations of edge computing. In VFC, the idle resources of moving and parked vehicles can be used for compute-intensive applications of resource-...
Highlights- The selection of an appropriate target fog node in Vehicular Fog Computing’s (VFC) is a complex process.
Comments
Information & Contributors
Information
Published In
© 2024 – IOS Press. All rights reserved.
Publisher
IOS Press
Netherlands
Publication History
Published: 01 January 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025