Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks
The Ka-band and higher Q/V band channels can provide an appealing capacity for the future deep-space communications and Space Information Networks (SIN), which are viewed as a primary solution to satisfy the increasing demands for high data rate services. However, Ka-band channel is much more sensit...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2017-09-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/19/10/510 |
| id |
doaj-688809048acd4198b695ea63deeef345 |
|---|---|
| record_format |
Article |
| spelling |
doaj-688809048acd4198b695ea63deeef3452020-11-25T00:55:09ZengMDPI AGEntropy1099-43002017-09-01191051010.3390/e19100510e19100510Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information NetworksJian Jiao0Xindong Sui1Shushi Gu2Shaohua Wu3Qinyu Zhang4These authors contributed equally to this work.These authors contributed equally to this work.These authors contributed equally to this work.Communication Engineering Research Centre, Harbin Institute of Technology Shenzhen, HIT Campus of University Town of Shenzhen, Shenzhen 518055, ChinaCommunication Engineering Research Centre, Harbin Institute of Technology Shenzhen, HIT Campus of University Town of Shenzhen, Shenzhen 518055, ChinaThe Ka-band and higher Q/V band channels can provide an appealing capacity for the future deep-space communications and Space Information Networks (SIN), which are viewed as a primary solution to satisfy the increasing demands for high data rate services. However, Ka-band channel is much more sensitive to the weather conditions than the conventional communication channels. Moreover, due to the huge distance and long propagation delay in SINs, the transmitter can only obtain delayed Channel State Information (CSI) from feedback. In this paper, the noise temperature of time-varying rain attenuation at Ka-band channels is modeled to a two-state Gilbert–Elliot channel, to capture the channel capacity that randomly ranging from good to bad state. An optimal transmission scheme based on Partially Observable Markov Decision Processes (POMDP) is proposed, and the key thresholds for selecting the optimal transmission method in the SIN communications are derived. Simulation results show that our proposed scheme can effectively improve the throughput.https://www.mdpi.com/1099-4300/19/10/510space information networksKa-bandGilbert–Elliot channelpartially observable Markov decision processes |
| collection |
DOAJ |
| language |
English |
| format |
Article |
| sources |
DOAJ |
| author |
Jian Jiao Xindong Sui Shushi Gu Shaohua Wu Qinyu Zhang |
| spellingShingle |
Jian Jiao Xindong Sui Shushi Gu Shaohua Wu Qinyu Zhang Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks Entropy space information networks Ka-band Gilbert–Elliot channel partially observable Markov decision processes |
| author_facet |
Jian Jiao Xindong Sui Shushi Gu Shaohua Wu Qinyu Zhang |
| author_sort |
Jian Jiao |
| title |
Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks |
| title_short |
Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks |
| title_full |
Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks |
| title_fullStr |
Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks |
| title_full_unstemmed |
Partially Observable Markov Decision Process-Based Transmission Policy over Ka-Band Channels for Space Information Networks |
| title_sort |
partially observable markov decision process-based transmission policy over ka-band channels for space information networks |
| publisher |
MDPI AG |
| series |
Entropy |
| issn |
1099-4300 |
| publishDate |
2017-09-01 |
| description |
The Ka-band and higher Q/V band channels can provide an appealing capacity for the future deep-space communications and Space Information Networks (SIN), which are viewed as a primary solution to satisfy the increasing demands for high data rate services. However, Ka-band channel is much more sensitive to the weather conditions than the conventional communication channels. Moreover, due to the huge distance and long propagation delay in SINs, the transmitter can only obtain delayed Channel State Information (CSI) from feedback. In this paper, the noise temperature of time-varying rain attenuation at Ka-band channels is modeled to a two-state Gilbert–Elliot channel, to capture the channel capacity that randomly ranging from good to bad state. An optimal transmission scheme based on Partially Observable Markov Decision Processes (POMDP) is proposed, and the key thresholds for selecting the optimal transmission method in the SIN communications are derived. Simulation results show that our proposed scheme can effectively improve the throughput. |
| topic |
space information networks Ka-band Gilbert–Elliot channel partially observable Markov decision processes |
| url |
https://www.mdpi.com/1099-4300/19/10/510 |
| work_keys_str_mv |
AT jianjiao partiallyobservablemarkovdecisionprocessbasedtransmissionpolicyoverkabandchannelsforspaceinformationnetworks AT xindongsui partiallyobservablemarkovdecisionprocessbasedtransmissionpolicyoverkabandchannelsforspaceinformationnetworks AT shushigu partiallyobservablemarkovdecisionprocessbasedtransmissionpolicyoverkabandchannelsforspaceinformationnetworks AT shaohuawu partiallyobservablemarkovdecisionprocessbasedtransmissionpolicyoverkabandchannelsforspaceinformationnetworks AT qinyuzhang partiallyobservablemarkovdecisionprocessbasedtransmissionpolicyoverkabandchannelsforspaceinformationnetworks |
| _version_ |
1725231805816111104 |