Computation Offloading and Resource Allocation in Mobile Edge Computing-enabled IoT Network

Hao Yang; Huifu Zhang; Ziyi Gong

doi:10.54097/3P4OmW85

Authors

Hao Yang
Huifu Zhang
Ziyi Gong

DOI:

https://doi.org/10.54097/3P4OmW85

Keywords:

Computation Offloading, Mobile Edge Computing, Resource Allocation, Entropy, Deep Reinforcement Learning, Internet of Things (IoT)

Abstract

Mobile edge computation (MEC)-enabled Internet of Things (IoT) network have gained significant attention from academia and industry due to its ability to provide ultra-low latency computation services for several IoT applications such as VR/AR, smart city and online gaming, etc. This article explores the challenge problem of jointly addressing computation offloading and resource allocation (CORA) in a time-varying MEC-enabled IoT network. Firstly, we propose a multiuser and multiserver MEC-enabled IoT architecture based on centralized management for the decision-making process of CORA. Secondly, we formulate a task execution delay minimization problem considering energy consumption and resource constraints. It is challenging to solve this problem using traditional methods due to the coupling between the variables, as well as the dynamic nature of the network. To this end, we convert the original problem into a Markov Decision Process (MDP). Then, an entropy-based deep reinforcement learning algorithm (EDRL) with strong exploration capabilities and stability is used to learn the dynamic CORA strategy. Finally, extensive simulation experiments have indicated that our proposed EDRL method exhibits superior learning ability and stability compared to the DDPG. Except for the exhaustive method, EDRL outperforms other baselines with respect to execution delay and energy consumption.

Downloads

Download data is not yet available.

References

P. Bellavista, J. Berrocal, A. Corradi, S.K. Das, L. Foschini, A. Zanni, A survey on fog computing for the Internet of Things, Pervasive and Mobile Computing. 52 (2019) 71–99. https://doi.org/10.1016/j.pmcj.2018.12.007.

H. Tan, An efficient IoT group association and data sharing mechanism in edge computing paradigm, Cyber Security and Applications.1(2023)100003.https://doi.org/10.1016/j.csa.2022.100003.

E. Liu, E. Effiok, J. Hitchcock, Survey on health care applications in 5G networks, IET Communications. 14 (2020) 1073–1080. https://doi.org/10.1049/iet-com.2019.0813.

F. Mogyorosi, P. Babarczi, J. Zerwas, A. Blenk, A. Pasic, Resilient Control Plane Design for Virtualized 6G Core Networks, IEEE Trans. Netw. Serv. Manage. 19 (2022) 2453–2467. https://doi.org/10.1109/TNSM.2022.3193241.

T. Alfakih, M.M. Hassan, A. Gumaei, C. Savaglio, G. Fortino, Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA,IEEEAccess.8(2020)54074–54084. https:// doi.org/ 10. 1109/ACCESS.2020.2981434.

H. Wu, K. Wolter, P. Jiao, Y. Deng, Y. Zhao, M. Xu, EEDTO: An Energy-Efficient Dynamic Task Offloading Algorithm for Blockchain-Enabled IoT-Edge-Cloud Orchestrated Computing, IEEE Internet Things J. 8 (2021) 2163–2176. https://doi.org/ 10.1109/JIOT.2020.3033521.

D.B. Son, T.H. Binh, H.K. Vo, B.M. Nguyen, H.T.T. Binh, S. Yu, Value-based reinforcement learning approaches for task offloading in Delay Constrained Vehicular Edge Computing, Engineering Applications of Artificial Intelligence. 113 (2022) 104898. https://doi.org/10.1016/j.engappai.2022.104898.

L.-A. Phan, D.-T. Nguyen, M. Lee, D.-H. Park, T. Kim, Dynamic fog-to-fog offloading in SDN-based fog computing systems, Future Generation Computer Systems. 117 (2021) 486–497. https://doi.org/10.1016/j.future.2020.12.021.

A. Mukherjee, D. De, D.G. Roy, A Power and Latency Aware Cloudlet Selection Strategy for Multi-Cloudlet Environment, IEEETrans.CloudComput.7(2019)141154.https://doi.org/10.1109/TCC.2016.2586061.

D. Niu, Y. Li, Z. Zhang, B. Song, A service collaboration method based on mobile edge computing in internet of things, Multimed Tools Appl. 82 (2023) 6505–6529. https://doi. org/ 10.1007/s11042-022-13394-x.

Z. Zhang, W. Zhang, F.-H. Tseng, Satellite Mobile Edge Computing: Improving QoS of High-Speed Satellite-Terrestrial Networks Using Edge Computing Techniques, IEEE Network. 33 (2019) 70–76. https://doi.org/ 10.1109/ MNET. 2018.1800172.

Q. Li, S. Wang, A. Zhou, X. Ma, F. Yang, A.X. Liu, QoS Driven Task Offloading with Statistical Guarantee in Mobile Edge Computing, IEEE Trans. on Mobile Comput. (2020) 1–1. https://doi.org/10.1109/TMC.2020.3004225.

Y.-H. Hung, C.-Y. Wang, R.-H. Hwang, Optimizing Social Welfare of Live Video Streaming Services in Mobile Edge Computing, IEEE Trans. on Mobile Comput. 19 (2020) 922–934. https://doi.org/10.1109/TMC.2019.2901786.

Y. Zhan, S. Guo, P. Li, J. Zhang, A Deep Reinforcement Learning Based Offloading Game in Edge Computing, IEEE Trans. Comput. 69 (2020) 883–893. https://doi. org/10. 1109/ TC.2020.2969148.

X. Chen, L. Jiao, W. Li, X. Fu, Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing, IEEE/ACM Trans. Networking. 24 (2016) 2795–2808. https:// doi.org/ 10.1109/TNET.2015.2487344.

C. Li, M. Song, H. Tang, Y. Luo, Offloading and system resource allocation optimization in TDMA based wireless powered mobile edge computing, Journal of Systems Architecture. 98 (2019) 221–230. https:// doi.org/ 10.1016/j. sysarc. 2019.07.009.

K. Guo, M. Yang, Y. Zhang, X. Jia, Efficient resource assignment in mobile edge computing: A dynamic congestion-aware offloading approach, Journal of Network and Computer Applications. 134 (2019) 40–51. https://doi.org/ 10.1016/j. jnca.2019.02.017.

F. Wang, J. Xu, S. Cui, Optimal Energy Allocation and Task Offloading Policy for Wireless Powered Mobile Edge Computing Systems, IEEE Trans. Wireless Commun. 19 (2020) 24432459.https://doi.org/10.1109/TWC.2020.2964765.

P.-Q. Huang, Y. Wang, K. Wang, Z.-Z. Liu, A Bilevel Optimization Approach for Joint Offloading Decision and Resource Allocation in Cooperative Mobile Edge Computing, IEEE Trans. Cybern. 50 (2020) 4228–4241. https://doi.org/ 10. 1109/TCYB.2019.2916728.

C.S. Chidume, C.O. Nnamani, Intelligent user-collaborative edge device APC-based MEC 5G IoT for computational offloading and resource allocation, Journal of Parallel and Distributed Computing. 169 (2022) 286–300. https://doi.org/ 10. 1016/j.jpdc.2022.07.007.

S. Yang, G. Lee, L. Huang, Deep Learning-Based Dynamic Computation Task Offloading for Mobile Edge Computing Networks, Sensors.22(2022) 4088.https:// doi.org/ 10.3390/ s22114088.

R. Du, C. Liu, Y. Gao, P. Hao, Z. Wang, Collaborative Cloud-Edge-End Task Offloading in NOMA-Enabled Mobile Edge Computing Using Deep Learning, J Grid Computing. 20 (2022) 14. https://doi.org/10.1007/s10723-022-09605-2.

V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, M. Riedmiller, Playing Atari with Deep Reinforcement Learning, (2013). http://arxiv.org/ abs/ 1312. 5602 (accessed July 30, 2023).

T.P. Lillicrap, J.J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, D. Wierstra, Continuous control with deep reinforcementlearning, (2019). http://arxiv. org/abs/ 1509. 02971 (accessed July 30, 2023).

T. Haarnoja, A. Zhou, P. Abbeel, S. Levine, Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor, in: J. Dy, A. Krause (Eds.), Proceedings of the 35th International Conference on Machine Learning, PMLR, 2018: pp. 1861–1870. https:// proceedings. mlr. press/v80/haarnoja18b.html.

H. Zhou, K. Jiang, X. Liu, X. Li, V.C.M. Leung, Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing, IEEE Internet Things J.9(2022)1517-1530.https:// doi.org/ 10.1109/ JIOT. 2021. 3091142.

I.A. Elgendy, W.-Z. Zhang, H. He, B.B. Gupta, A.A. Abd El-Latif, Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms, Wireless Netw. 27 (2021) 2023–2038. https:// doi.org/10.1007/s11276-021-02554-w.

J. Yan, S. Bi, Y.J.A. Zhang, Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach, IEEE Trans. WirelessCommun.19(2020)5404-5419. https:// doi.org/ 10. 1109/TWC.2020.2993071.

Y. Pourasad, R. Ranjbarzadeh, A. Mardani, A New Algorithm for Digital Image Encryption Based on Chaos Theory, Entropy. 23 (2021) 341. https://doi.org/10.3390/e23030341.