An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network

As one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource a...

Full description

Bibliographic Details
Main Authors: Taihui Li, Xiaorong Zhu, Xu Liu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9131779/
id doaj-cbdbbb345440451e92b8955e17c39e07
record_format Article
spelling doaj-cbdbbb345440451e92b8955e17c39e072021-03-30T02:35:39ZengIEEEIEEE Access2169-35362020-01-01812222912224010.1109/ACCESS.2020.30065029131779An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G NetworkTaihui Li0https://orcid.org/0000-0003-4659-2366Xiaorong Zhu1Xu Liu2Wireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaWireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaWireless Communication Key Lab of Jiangsu Province, Nanjing University of Posts and Telecommunications, Nanjing, ChinaAs one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource allocation algorithm based on Deep Q-Networks (DQN), which is suitable for multi-slice and multi-service scenarios. This algorithm jointly considers the radio access network slices and core network slices to dynamically allocate resources to maximize the number of access users. First we build such a model, which is a mixed integer programming problem and it needs to be dynamically adjusted according to the changes of environment. We propose to use DQN algorithm to solve this problem, which can perceive changes in the environment and make dynamic decisions. Under each decision, we need to calculate the reward value of DQN, so we divide the problem into the core side and the access side. Then the dynamic knapsack algorithm and the link mapping algorithm are used to obtain the reward. The simulation results show that the average access rate of DQN scheme is higher than 97%. Compared with the optimal allocation scheme of access side, the average access rate is increased by 9% for delay constrained slices and 5% for rate constrained slices in a dynamic environment.https://ieeexplore.ieee.org/document/9131779/5G networknetwork slicingresource allocationdeep Q-networks
collection DOAJ
language English
format Article
sources DOAJ
author Taihui Li
Xiaorong Zhu
Xu Liu
spellingShingle Taihui Li
Xiaorong Zhu
Xu Liu
An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
IEEE Access
5G network
network slicing
resource allocation
deep Q-networks
author_facet Taihui Li
Xiaorong Zhu
Xu Liu
author_sort Taihui Li
title An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
title_short An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
title_full An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
title_fullStr An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
title_full_unstemmed An End-to-End Network Slicing Algorithm Based on Deep Q-Learning for 5G Network
title_sort end-to-end network slicing algorithm based on deep q-learning for 5g network
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description As one of key technologies of the fifth-generation (5G) communication system, network slicing can share the underlying infrastructure with different application requirements and ensure that the slices can be isolated from each other. This paper proposes an end-to-end (E2E) network slicing resource allocation algorithm based on Deep Q-Networks (DQN), which is suitable for multi-slice and multi-service scenarios. This algorithm jointly considers the radio access network slices and core network slices to dynamically allocate resources to maximize the number of access users. First we build such a model, which is a mixed integer programming problem and it needs to be dynamically adjusted according to the changes of environment. We propose to use DQN algorithm to solve this problem, which can perceive changes in the environment and make dynamic decisions. Under each decision, we need to calculate the reward value of DQN, so we divide the problem into the core side and the access side. Then the dynamic knapsack algorithm and the link mapping algorithm are used to obtain the reward. The simulation results show that the average access rate of DQN scheme is higher than 97%. Compared with the optimal allocation scheme of access side, the average access rate is increased by 9% for delay constrained slices and 5% for rate constrained slices in a dynamic environment.
topic 5G network
network slicing
resource allocation
deep Q-networks
url https://ieeexplore.ieee.org/document/9131779/
work_keys_str_mv AT taihuili anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
AT xiaorongzhu anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
AT xuliu anendtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
AT taihuili endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
AT xiaorongzhu endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
AT xuliu endtoendnetworkslicingalgorithmbasedondeepqlearningfor5gnetwork
_version_ 1724184892562997248