Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions

Current extended virtual reality (VR) applications use 360-degree video to boost viewers' sense of presence and immersion. The quality of experience (QoE) effectiveness of 360-degree video in VR has often been related to many aspects. The four significant aspects to take into account when evalu...

Full description

Bibliographic Details
Main Authors: Muhammad Shahid Anwar, Jing Wang, Sadique Ahmad, Wahab Khan, Asad Ullah, Mudassir Shah, Zesong Fei
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9253366/
id doaj-b144e7546b7b4794b40bfd3c0831a42d
record_format Article
spelling doaj-b144e7546b7b4794b40bfd3c0831a42d2021-03-30T04:12:56ZengIEEEIEEE Access2169-35362020-01-01820458520459610.1109/ACCESS.2020.30372539253366Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE PredictionsMuhammad Shahid Anwar0https://orcid.org/0000-0001-8093-6690Jing Wang1https://orcid.org/0000-0002-3653-9951Sadique Ahmad2https://orcid.org/0000-0001-6907-2318Wahab Khan3Asad Ullah4Mudassir Shah5Zesong Fei6School of Information and Electronics, Beijing Institute of Technology, Beijing, ChinaSchool of Information and Electronics, Beijing Institute of Technology, Beijing, ChinaDepartment of Computer Science, Bahria University Karachi Campus, Karachi, PakistanSchool of Information and Electronics, Beijing Institute of Technology, Beijing, ChinaDepartment of CS/IT, Sarhad University of Science and Information Technology, Peshawar, PakistanCollege of Electronics Science and Technology, Xiamen University, Xiamen, ChinaSchool of Information and Electronics, Beijing Institute of Technology, Beijing, ChinaCurrent extended virtual reality (VR) applications use 360-degree video to boost viewers' sense of presence and immersion. The quality of experience (QoE) effectiveness of 360-degree video in VR has often been related to many aspects. The four significant aspects to take into account when evaluating QoE in the VR are a sense of presence and immersion, acceptability, reality judgment, and attention captivated. In this manuscript, we subjectively investigate the impact of 360-degree videos QoE-affecting factors, including quantization parameters (QP), resolutions, initial delay, and different interruptions (single interruption and two interruptions) on these QoE-aspects. We then design a Decision Tree-based (DT) prediction models that predict users' VR immersion, acceptability, reality judgment, and attention captivated based on subjective data. The accuracy performance of the DT-based model is then analyzed with respect to mean absolute error (MAE), precision, accuracy rate, recall, and f1-score. The DT-based prediction model performs well with a 91% to 93% prediction accuracy, which is in close agreement with the subjective experiment. Finally, we compare the performance accuracy of the proposed model against existing Machine learning methods. Our DT-based prediction model outperforms state-of-the-art QoE prediction methods.https://ieeexplore.ieee.org/document/9253366/Quality of Experience360-degree videosvirtual realitydecision treemachine learning
collection DOAJ
language English
format Article
sources DOAJ
author Muhammad Shahid Anwar
Jing Wang
Sadique Ahmad
Wahab Khan
Asad Ullah
Mudassir Shah
Zesong Fei
spellingShingle Muhammad Shahid Anwar
Jing Wang
Sadique Ahmad
Wahab Khan
Asad Ullah
Mudassir Shah
Zesong Fei
Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
IEEE Access
Quality of Experience
360-degree videos
virtual reality
decision tree
machine learning
author_facet Muhammad Shahid Anwar
Jing Wang
Sadique Ahmad
Wahab Khan
Asad Ullah
Mudassir Shah
Zesong Fei
author_sort Muhammad Shahid Anwar
title Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
title_short Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
title_full Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
title_fullStr Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
title_full_unstemmed Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
title_sort impact of the impairment in 360-degree videos on users vr involvement and machine learning-based qoe predictions
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Current extended virtual reality (VR) applications use 360-degree video to boost viewers' sense of presence and immersion. The quality of experience (QoE) effectiveness of 360-degree video in VR has often been related to many aspects. The four significant aspects to take into account when evaluating QoE in the VR are a sense of presence and immersion, acceptability, reality judgment, and attention captivated. In this manuscript, we subjectively investigate the impact of 360-degree videos QoE-affecting factors, including quantization parameters (QP), resolutions, initial delay, and different interruptions (single interruption and two interruptions) on these QoE-aspects. We then design a Decision Tree-based (DT) prediction models that predict users' VR immersion, acceptability, reality judgment, and attention captivated based on subjective data. The accuracy performance of the DT-based model is then analyzed with respect to mean absolute error (MAE), precision, accuracy rate, recall, and f1-score. The DT-based prediction model performs well with a 91% to 93% prediction accuracy, which is in close agreement with the subjective experiment. Finally, we compare the performance accuracy of the proposed model against existing Machine learning methods. Our DT-based prediction model outperforms state-of-the-art QoE prediction methods.
topic Quality of Experience
360-degree videos
virtual reality
decision tree
machine learning
url https://ieeexplore.ieee.org/document/9253366/
work_keys_str_mv AT muhammadshahidanwar impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT jingwang impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT sadiqueahmad impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT wahabkhan impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT asadullah impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT mudassirshah impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
AT zesongfei impactoftheimpairmentin360degreevideosonusersvrinvolvementandmachinelearningbasedqoepredictions
_version_ 1724182231781474304