An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
As one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource a...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9131779/ |
id |
doaj-cbdbbb345440451e92b8955e17c39e07 |
---|---|
record_format |
Article |
spelling |
doaj-cbdbbb345440451e92b8955e17c39e072021-03-30T02:35:39ZengIEEEIEEE Access2169-35362020-01-01812222912224010.1109/ACCESS.2020.30065029131779An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G NetworkTaihui Li0https://orcid.org/0000-0003-4659-2366Xiaorong Zhu1Xu Liu2Wireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaWireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaWireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaAs one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource allocation algorithm based on Deep Q-Networks (DQN), which is suitable for multi-slice and multi-service scenarios. This algorithm jointly considers the radio access network slices and core network slices to dynamically allocate resources to maximize the number of access users. First we build such a model, which is a mixed integer programming problem and it needs to be dynamically adjusted according to the changes of environment. We propose to use DQN algorithm to solve this problem, which can perceive changes in the environment and make dynamic decisions. Under each decision, we need to calculate the reward value of DQN, so we divide the problem into the core side and the access side. Then the dynamic knapsack algorithm and the link mapping algorithm are used to obtain the reward. The simulation results show that the average access rate of DQN scheme is higher than 97%. Compared with the optimal allocation scheme of access side, the average access rate is increased by 9% for delay constrained slices and 5% for rate constrained slices in a dynamic environment.https://ieeexplore.ieee.org/document/9131779/5G networknetwork slicingresource allocationdeep Q-networks |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Taihui Li Xiaorong Zhu Xu Liu |
spellingShingle |
Taihui Li Xiaorong Zhu Xu Liu An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network IEEE Access 5G network network slicing resource allocation deep Q-networks |
author_facet |
Taihui Li Xiaorong Zhu Xu Liu |
author_sort |
Taihui Li |
title |
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network |
title_short |
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network |
title_full |
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network |
title_fullStr |
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network |
title_full_unstemmed |
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network |
title_sort |
end-to-end network slicing algorithm based on deep q-learning for 5g network |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
As one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource allocation algorithm based on Deep Q-Networks (DQN), which is suitable for multi-slice and multi-service scenarios. This algorithm jointly considers the radio access network slices and core network slices to dynamically allocate resources to maximize the number of access users. First we build such a model, which is a mixed integer programming problem and it needs to be dynamically adjusted according to the changes of environment. We propose to use DQN algorithm to solve this problem, which can perceive changes in the environment and make dynamic decisions. Under each decision, we need to calculate the reward value of DQN, so we divide the problem into the core side and the access side. Then the dynamic knapsack algorithm and the link mapping algorithm are used to obtain the reward. The simulation results show that the average access rate of DQN scheme is higher than 97%. Compared with the optimal allocation scheme of access side, the average access rate is increased by 9% for delay constrained slices and 5% for rate constrained slices in a dynamic environment. |
topic |
5G network network slicing resource allocation deep Q-networks |
url |
https://ieeexplore.ieee.org/document/9131779/ |
work_keys_str_mv |
AT taihuili anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork AT xiaorongzhu anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork AT xuliu anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork AT taihuili endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork AT xiaorongzhu endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork AT xuliu endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork |
_version_ |
1724184892562997248 |