Research Article | ![]()
A Multi-Agent Deep Reinforcement Learning Framework for MEC Resource Allocation in 5G Networks
Author(s): Meghamala Y1*, Pulipati John Paul2, and M Aravind Kumar3
Published In : International Journal of Electrical and Electronics Research (IJEER) Volume 13, Issue 4
Publisher : FOREX Publication
Published : 30 December 2025
e-ISSN : 2347-470X
Page(s) : 909-919
Abstract
This paper introduces a multi-agent Deep Reinforcement Learning (DRL)-based model of allocating resources in 5G MEC networks based on the Soft Actor-Critic (SAC) algorithm and the hierarchical MATD3/TD2PG-based actor-critic network. The model distributes sub-channels, power of transmission and MEC computing resources with taking into account user mobility and isolation of the slices. The Python simulation is provided with a Manhattan 5G environment comprising of four interconnected gNodeBs, 5 densities of users (327, 499, 596, 930 and 1088 users), and two MEC classes of service (security and entertainment) with predefined bandwidth, memory, and processing requirements. It is assessed against three baselines: Greedy, Best-fit and Worst-fit allocation strategies in three measures; number of services served, services blocked and services denied. Findings indicate that SAC-based allocation improves the number of services served by 8-14, blocked by 15-22 and denied services by 18-20, respectively, with respect to user density. The advantages of these results support that the suggested multi-agent model, which is SAC-based, offers a measurable performance increase in the given dynamic traffic and heterogeneous service conditions.
Keywords: 5G, MEC, Resource Allocation, DRL, SAC Model.
Meghamala Y*, Dept of Electronics and communication Engineering, Bharatiya Engineering Science & Technology Innovation University (BESTIU), Andhra Pradesh, India; Email: meghamala7@gmail.com
Pulipati John Paul, Ellenki College of Engineering and Technology, Patancheru, Telangana, India; Email: jppulipati@yahoo.com
M Aravind Kumar, West Godavari Institute of Science and Engineering, Prakashraopalem, East Godavari, Andhra Pradesh, India; Email: drmaravindkumar@gmail.com
-
[1] O. Abuajwa, M. B. Roslee, Z. B. Yusoff, L. L. Chuan, and P. W. Leong, “Resource Allocation for Throughput versus Fairness Trade-Offs under User Data Rate Fairness in NOMA Systems in 5G Networks,” *Appl. Sci.*, vol. 12, no. 1, pp. 1–20, 2022.
-
[2] S. S. Sefati et al., "A Comprehensive Survey on Resource Management in 6G Network Based on Internet of Things," in IEEE Access, vol. 12, pp. 113741-113784, 2024.
-
[3] A. Minalkar, S. Doss, and R. Doshi, “A Study of the Resource Allocation Mechanism for Secure Video Transmission in 5G Networks,” in *Proc. 2023 IEEE Int. Conf. on Contemporary Computing and Communications (InC4)*, 2023, pp. 1–6.
-
[4] Y. L. Lee and D. Qin, "A Survey on Applications of Deep Reinforcement Learning in Resource Management for 5G Heterogeneous Networks," 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China, 2019, pp. 1856-1862.
-
[5] B. Agarwal, M. A. Togou, M. Ruffini, and G. Muntean, “A Low Complexity ML-Assisted Multi-Knapsack-Based Approach for User Association and Resource Allocation in 5G HetNets,” in *Proc. IEEE Int. Symp. on Broadband Multimedia Systems and Broadcasting (BMSB)*, 2023, pp. 1–6.
-
[6] F. Bahramisirat, M. A. Gregory and S. Li, "Multi-Access Edge Computing Resource Slice Allocation: A Review," in IEEE Access, vol. 12, pp. 188572-188589, 2024.
-
[7] P. K. Rebari and B. R. Killi, “Deep Learning Based Traffic Prediction for Resource Allocation in Multi-Tenant Virtualized 5G Networks,” in *Proc. TENCON 2023 – IEEE Region 10 Conf.*, 2023, pp. 97–102.
-
[8] S. O. Oladejo and O. E. Falowo, "Latency-Aware Dynamic Resource Allocation Scheme for 5G Heterogeneous Network: A Network Slicing-Multitenancy Scenario," 2019 International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), Barcelona, Spain, pp. 1-7, 2019.
-
[9] F. Allagiotis, C. Bouras, V. Kokkinos, A. Gkamas, and P. Pouyioutas, “Reinforcement Learning Approach for Resource Allocation in 5G HetNets,” in *Proc. 2023 Int. Conf. on Information Networking (ICOIN)*, 2023, pp. 387–392.
-
[10] S. Kumar, R. Mahapatra and A. Singh, "Power allocation in 5G HetNets: A Federated Learning Approach," 2022 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS), Gandhinagar, Gujarat, India, pp. 275-280, 2022.
-
[11] S. Ghosh and D. De, “TARA: Weighted Majority Cooperative Game Theory-Based Task Assignment and Resource Allocation in 5G Heterogeneous Fog Network for IoT,” *J. Supercomput.*, vol. 79, pp. 14633–14683, 2023.
-
[12] K. Tsachrelias, C. Katsigiannis, V. Kokkinos, A. Gkamas, C. Bouras, and P. Pouyioutas, “Optimizing Resource Allocation in 5G MIMO Networks Using DUDe Techniques,” in *Proc. 2024 14th Int. Symp. on Communication Systems, Networks and Digital Signal Processing (CSNDSP)*, 2024, pp. 454–459.
-
[13] C. Wang and W. -C. Hsiao, "Resource Allocation using Artificial Intelligence for Vehicle-to-Everything (V2X) Communications on Licensed and Unlicensed Spectrum," 2024 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Kaohsiung, Taiwan, pp. 1-4, 2024.
-
[14] N. M. Laboni et al., “A Hyper Heuristic Algorithm for Efficient Resource Allocation in 5G Mobile Edge Clouds,” *IEEE Trans. Mobile Comput.*, vol. 23, pp. 29–41, 2024.
-
[15] M. Talaat Fahim, M. Ibrahim, and N. M. Elshennawy, “Efficient Resource Allocation of Latency Aware Slices for 5G Networks,” *J. Eng. Res.*, 2023.
-
[16] J. Xu, “Efficient Trajectory Optimization and Resource Allocation in UAV 5G Networks Using Dueling-Deep-Q-Networks,” *Wireless Netw.*, pp. 1–11, 2023.
-
[17] Y. -H. Tu, Y. -W. Ma, Z. -X. Li, J. -L. Chen and K. Tsukamoto, "Applying Deep Reinforcement Learning for Self-organizing Network Architecture," 2023 IEEE 6th International Conference on Knowledge Innovation and Invention (ICKII), Sapporo, Japan, pp. 16-20, 2023.
-
[18] R. Dubey, P. K. Mishra, and S. Pandey, “SGR-MOP Based Secrecy-Enabled Resource Allocation Scheme for 5G Networks,” *J. Netw. Syst. Manag.*, vol. 31, pp. 1–26, 2023.
-
[19] H. Zhang, S. Xu, S. Zhang and Z. Jiang, "Slicing Framework for Service Level Agreement Guarantee in Heterogeneous Networks—A Deep Reinforcement Learning Approach," in IEEE Wireless Communications Letters, vol. 11, no. 1, pp. 193-197, Jan. 2022.
-
[20] T. Verma, A. Raza, S. Shrivastava, A. Kumar, D. P. Kothari and U. D. Dwivedi, "A Novel On-Policy DRL-Based Approach for Resource Allocation in Hybrid RF/VLC Systems," in IEEE Transactions on Consumer Electronics, vol. 71, no. 1, pp. 550-560, Feb. 2025.
-
[21] A. K. Tiwari, P. K. Mishra, S. Pandey, and P. R. Teja, “Resource Allocation and Mode Selection in 5G Networks Based on Energy Efficient Game Theory Approach,” *Int. J. Recent Innov. Trends Comput. Commun.*, 2022.
-
[22] W. Jing, J. Wang, J. Ren, Z. Lu, H. Shao and X. Wen, "Radio Resource Allocation Optimization for Delay-Sensitive Services Based on Graph Neural Networks and Offline Dataset," in IEEE Transactions on Vehicular Technology, vol. 74, no. 3, pp. 4510-4525, March 2025.
-
[23] J. Lin, P. Chou, and R. Hwang, “Dynamic Resource Allocation for Network Slicing with Multi-Tenants in 5G Two-Tier Networks,” *Sensors*, vol. 23, 2023.
-
[24] S. Lavanya, N. M. S. Kumar, S. Thilagam and S. Sinduja, "Fog computing-based radio access network in 5G wireless communications," 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, pp. 559-563, India, 2017.
-
[25] H. Tsai, S. Kao, Y. Huang, and F. Chang, “Energy-Aware Mode Selection for D2D Resource Allocation in 5G Networks,” *Electronics*, 2023.
-
[26] M. Karuppiyan, H. Subramani, S. Kandasamy Raju, and M. Maradi Anthonymuthu Prakasam, “Dynamic Resource Allocation in 5G Networks Using Hybrid RL-CNN Model for Optimized Latency and Quality of Service,” *Netw.*, pp. 1–25, 2024.
-
[27] J. Menard, A. Al-Habashna, G. A. Wainer, and G. Boudreau, “Distributed Resource Allocation in 5G Networks with Multi-Agent Reinforcement Learning,” in *Proc. 2022 Annual Modeling and Simulation Conf. (ANNSIM)*, 2022, pp. 802–813.
-
[28] L. Liu, X. Yuan, D. Chen, N. Zhang, H. Sun, and A. Taherkordi, “Multi-User Dynamic Computation Offloading and Resource Allocation in 5G MEC Heterogeneous Networks with Static and Dynamic Subchannels,” *IEEE Trans. Veh. Technol.*, vol. 72, pp. 14924–14938, 2023.
-
[29] J. Logeshwaran, N. Shanmugasundaram, and J. Lloret, “Energy-Efficient Resource Allocation Model for Device-to-Device Communication in 5G Wireless Personal Area Networks,” *Int. J. Commun. Syst.*, vol. 36, 2023.
-
[30] M. Khani, S. Jamali, M. K. Sohrabi, M. M. Sadr, and A. Ghaffari, “Resource Allocation in 5G Cloud-RAN Using Deep Reinforcement Learning Algorithms: A Review,” *Trans. Emerg. Telecommun. Technol.*, vol. 35, 2023.
-
[31] A. Hegde, R. Song, and A. Festag, “Radio Resource Allocation in 5G-NR V2X: A Multi-Agent Actor-Critic Based Approach,” *IEEE Access*, vol. 11, pp. 87225–87244, 2023.

I. J. of Electrical & Electronics Research