Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks
The evolution of 5G technology presents unique challenges and opportunities for optimizing network performance through advanced techniques such as Reinforcement Learning (RL). Effective 5G network management requires precise optimization of subcarrier spacing and uplink-downlink (UL-DL) allocation,...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Conference paper |
Published: |
Institute of Electrical and Electronics Engineers Inc.
2025
|
Subjects: | |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.uniten.dspace-36900 |
---|---|
record_format |
dspace |
spelling |
my.uniten.dspace-369002025-03-03T15:45:37Z Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks Samidi F.S. Radzi N.A.M. Aripin N.M. 57215054855 57218936786 35092180800 Network performance Queueing networks Reinforcement learning Resource allocation Dynamic condition Efficient learning Learning process Networks management Optimisations Performance Real- time Reinforcement learning models Stable performance Subcarrier spacing 5G mobile communication systems The evolution of 5G technology presents unique challenges and opportunities for optimizing network performance through advanced techniques such as Reinforcement Learning (RL). Effective 5G network management requires precise optimization of subcarrier spacing and uplink-downlink (UL-DL) allocation, yet selecting the optimal RL model for this task remains a significant challenge. This paper evaluates the performance of RL models within the RaSSo framework for optimizing 5G networks, aiming to identify the most suitable RL approach. The primary challenge addressed is determining which RL model, in our case, Proximal Policy Optimization (PPO) or Advantage Actor-Critic (A2C), performs better in managing the dynamic and complex 5G environment. The study compares these models in terms of episode reward, entropy loss, value loss, and frames per second (FPS). The results indicate that PPO's stable performance, efficient learning process, and robust adaptation to dynamic conditions make it a more suitable choice for real-time 5G network management. The results indicate that PPO's stable performance, efficient learning process, and robust adaptation to dynamic conditions make it a more suitable choice for real-time 5G network management. Overall, this paper contributes to the field by offering a thorough comparison of RL models tailored for the nuanced demands of 5G network optimization, providing valuable insights for future advancements in this area. ? 2024 IEEE. Final 2025-03-03T07:45:36Z 2025-03-03T07:45:36Z 2024 Conference paper 10.1109/ICAEE62924.2024.10667637 2-s2.0-85204779257 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85204779257&doi=10.1109%2fICAEE62924.2024.10667637&partnerID=40&md5=609628a0e22f0de29dfebf4662237cff https://irepository.uniten.edu.my/handle/123456789/36900 Institute of Electrical and Electronics Engineers Inc. Scopus |
institution |
Universiti Tenaga Nasional |
building |
UNITEN Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Tenaga Nasional |
content_source |
UNITEN Institutional Repository |
url_provider |
http://dspace.uniten.edu.my/ |
topic |
Network performance Queueing networks Reinforcement learning Resource allocation Dynamic condition Efficient learning Learning process Networks management Optimisations Performance Real- time Reinforcement learning models Stable performance Subcarrier spacing 5G mobile communication systems |
spellingShingle |
Network performance Queueing networks Reinforcement learning Resource allocation Dynamic condition Efficient learning Learning process Networks management Optimisations Performance Real- time Reinforcement learning models Stable performance Subcarrier spacing 5G mobile communication systems Samidi F.S. Radzi N.A.M. Aripin N.M. Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
description |
The evolution of 5G technology presents unique challenges and opportunities for optimizing network performance through advanced techniques such as Reinforcement Learning (RL). Effective 5G network management requires precise optimization of subcarrier spacing and uplink-downlink (UL-DL) allocation, yet selecting the optimal RL model for this task remains a significant challenge. This paper evaluates the performance of RL models within the RaSSo framework for optimizing 5G networks, aiming to identify the most suitable RL approach. The primary challenge addressed is determining which RL model, in our case, Proximal Policy Optimization (PPO) or Advantage Actor-Critic (A2C), performs better in managing the dynamic and complex 5G environment. The study compares these models in terms of episode reward, entropy loss, value loss, and frames per second (FPS). The results indicate that PPO's stable performance, efficient learning process, and robust adaptation to dynamic conditions make it a more suitable choice for real-time 5G network management. The results indicate that PPO's stable performance, efficient learning process, and robust adaptation to dynamic conditions make it a more suitable choice for real-time 5G network management. Overall, this paper contributes to the field by offering a thorough comparison of RL models tailored for the nuanced demands of 5G network optimization, providing valuable insights for future advancements in this area. ? 2024 IEEE. |
author2 |
57215054855 |
author_facet |
57215054855 Samidi F.S. Radzi N.A.M. Aripin N.M. |
format |
Conference paper |
author |
Samidi F.S. Radzi N.A.M. Aripin N.M. |
author_sort |
Samidi F.S. |
title |
Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
title_short |
Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
title_full |
Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
title_fullStr |
Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
title_full_unstemmed |
Reinforcement Learning Model Selection for Resource Allocation and Subcarrier Spacing Optimization in 5G Sliced Spectrum Networks |
title_sort |
reinforcement learning model selection for resource allocation and subcarrier spacing optimization in 5g sliced spectrum networks |
publisher |
Institute of Electrical and Electronics Engineers Inc. |
publishDate |
2025 |
_version_ |
1825816122894581760 |
score |
13.244413 |