QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications
Hybrid control traffic and multimedia flow over emerging non‐orthogonal multiple access (NOMA) could provide both very low latency and very high bandwidth. In this study, a Q‐learning‐based resource allocation scheme is proposed to improve the quality of experience (QoE) for NOMA user equipment (UE)...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2020-09-01
|
Series: | IET Networks |
Subjects: | |
Online Access: | https://doi.org/10.1049/iet-net.2020.0021 |
id |
doaj-e4131f5ad66843eeb756e2c82dfc79ce |
---|---|
record_format |
Article |
spelling |
doaj-e4131f5ad66843eeb756e2c82dfc79ce2021-08-26T06:15:46ZengWileyIET Networks2047-49542047-49622020-09-019526226910.1049/iet-net.2020.0021QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communicationsShuan He0Wei Wang1Department of Computer ScienceSan Diego State University5500 Campanile DriveSan DiegoUSADepartment of Computer ScienceSan Diego State University5500 Campanile DriveSan DiegoUSAHybrid control traffic and multimedia flow over emerging non‐orthogonal multiple access (NOMA) could provide both very low latency and very high bandwidth. In this study, a Q‐learning‐based resource allocation scheme is proposed to improve the quality of experience (QoE) for NOMA user equipment (UE) in downlink wireless multimedia communications. In the proposed framework, the utility is modelled as the QoE with regard to communication resource cost, where UE acts as the agent in the reinforcement Q‐learning. UE observes the wireless channel states and takes resource allocation actions based on the immediate reward of QoE gain and communication cost. In addition, benefiting from the NOMA communications, the authors propose to solve the multiple agent reinforcement learning problems with the simplified sequential single agent reinforcement learning (SARL) approach. The numerical simulation results demonstrate the efficiency of the proposed Q‐QoE resource allocation framework and prove that the UE would obtain desirable QoE performance with the SARL scheme.https://doi.org/10.1049/iet-net.2020.0021Q‐QoE resource allocation frameworkQoE‐aware Q‐learning resource allocationmultimedia flowNOMA user equipmentcommunication resource costreinforcement Q‐learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Shuan He Wei Wang |
spellingShingle |
Shuan He Wei Wang QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications IET Networks Q‐QoE resource allocation framework QoE‐aware Q‐learning resource allocation multimedia flow NOMA user equipment communication resource cost reinforcement Q‐learning |
author_facet |
Shuan He Wei Wang |
author_sort |
Shuan He |
title |
QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications |
title_short |
QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications |
title_full |
QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications |
title_fullStr |
QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications |
title_full_unstemmed |
QoE‐aware Q‐learning resource allocation for NOMA wireless multimedia communications |
title_sort |
qoe‐aware q‐learning resource allocation for noma wireless multimedia communications |
publisher |
Wiley |
series |
IET Networks |
issn |
2047-4954 2047-4962 |
publishDate |
2020-09-01 |
description |
Hybrid control traffic and multimedia flow over emerging non‐orthogonal multiple access (NOMA) could provide both very low latency and very high bandwidth. In this study, a Q‐learning‐based resource allocation scheme is proposed to improve the quality of experience (QoE) for NOMA user equipment (UE) in downlink wireless multimedia communications. In the proposed framework, the utility is modelled as the QoE with regard to communication resource cost, where UE acts as the agent in the reinforcement Q‐learning. UE observes the wireless channel states and takes resource allocation actions based on the immediate reward of QoE gain and communication cost. In addition, benefiting from the NOMA communications, the authors propose to solve the multiple agent reinforcement learning problems with the simplified sequential single agent reinforcement learning (SARL) approach. The numerical simulation results demonstrate the efficiency of the proposed Q‐QoE resource allocation framework and prove that the UE would obtain desirable QoE performance with the SARL scheme. |
topic |
Q‐QoE resource allocation framework QoE‐aware Q‐learning resource allocation multimedia flow NOMA user equipment communication resource cost reinforcement Q‐learning |
url |
https://doi.org/10.1049/iet-net.2020.0021 |
work_keys_str_mv |
AT shuanhe qoeawareqlearningresourceallocationfornomawirelessmultimediacommunications AT weiwang qoeawareqlearningresourceallocationfornomawirelessmultimediacommunications |
_version_ |
1721196053781282816 |