Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums

The MOOC Discussion Forum is the place where students and teachers communicate, often plagued by information overload and confusion. Posts that students used to express confusion and demanded teachers' attention are most likely to be overwhelmed by the amount of noise in the forum. Therefore, h...

Full description

Bibliographic Details
Main Authors: Shou Xi Guo, Xia Sun, Shi Xiong Wang, Yi Gao, Jun Feng
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8764349/
id doaj-39fa192cdc3a46c2859457b912f590da
record_format Article
spelling doaj-39fa192cdc3a46c2859457b912f590da2021-04-05T17:20:36ZengIEEEIEEE Access2169-35362019-01-01712052212053210.1109/ACCESS.2019.29292118764349Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion ForumsShou Xi Guo0https://orcid.org/0000-0001-6374-1672Xia Sun1Shi Xiong Wang2Yi Gao3https://orcid.org/0000-0001-8441-6166Jun Feng4https://orcid.org/0000-0002-0706-2103College of Information Science and Technology, Northwest University, Xi’an, ChinaCollege of Information Science and Technology, Northwest University, Xi’an, ChinaCollege of Information Science and Technology, Northwest University, Xi’an, ChinaCollege of Information Science and Technology, Northwest University, Xi’an, ChinaCollege of Information Science and Technology, Northwest University, Xi’an, ChinaThe MOOC Discussion Forum is the place where students and teachers communicate, often plagued by information overload and confusion. Posts that students used to express confusion and demanded teachers' attention are most likely to be overwhelmed by the amount of noise in the forum. Therefore, how to pay attention to urgent posts in time has become a critical problem to be solved. In this paper, we present a new hybrid neural network for identifying “urgent” posts that require immediate attention from instructors. We proposed a semantic and structure extraction part including convolutional neural network (CNN) and gated recurrent unit (GRU), which can simultaneously learn the semantic information and structural information of sentences. In addition, Due to a lot of noise such as spelling mistakes and emoticons in the forum comment text, we propose to use Character-level Convolutional Networks (Char-CNN) to capture these special information. Finally, the semantic and structural information learned by the semantic and structural extraction part is merged with the character information learned by Char-CNN, and the attention mechanism to learn their weights, the final representation of the sentence can be obtained. In our experiments, we achieve urgent posts classification with a micro F-score of 91.8%, 91.3% and 88.4% on the Stanford MOOCPosts dataset, outperforming the state-of-the-art approach by 1.8%, 2.4% and 1.5% respectively. This work can help teachers prioritize their responses and better manage numerous posts. Teachers can answer learner questions in a timely manner and help reduce dropout rates and improve completion rates.https://ieeexplore.ieee.org/document/8764349/MOOCurgent postsconvolutional neural networkgated recurrent unitsemantic information and structural informationintervention learning
collection DOAJ
language English
format Article
sources DOAJ
author Shou Xi Guo
Xia Sun
Shi Xiong Wang
Yi Gao
Jun Feng
spellingShingle Shou Xi Guo
Xia Sun
Shi Xiong Wang
Yi Gao
Jun Feng
Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
IEEE Access
MOOC
urgent posts
convolutional neural network
gated recurrent unit
semantic information and structural information
intervention learning
author_facet Shou Xi Guo
Xia Sun
Shi Xiong Wang
Yi Gao
Jun Feng
author_sort Shou Xi Guo
title Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
title_short Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
title_full Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
title_fullStr Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
title_full_unstemmed Attention-Based Character-Word Hybrid Neural Networks With Semantic and Structural Information for Identifying of Urgent Posts in MOOC Discussion Forums
title_sort attention-based character-word hybrid neural networks with semantic and structural information for identifying of urgent posts in mooc discussion forums
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description The MOOC Discussion Forum is the place where students and teachers communicate, often plagued by information overload and confusion. Posts that students used to express confusion and demanded teachers' attention are most likely to be overwhelmed by the amount of noise in the forum. Therefore, how to pay attention to urgent posts in time has become a critical problem to be solved. In this paper, we present a new hybrid neural network for identifying “urgent” posts that require immediate attention from instructors. We proposed a semantic and structure extraction part including convolutional neural network (CNN) and gated recurrent unit (GRU), which can simultaneously learn the semantic information and structural information of sentences. In addition, Due to a lot of noise such as spelling mistakes and emoticons in the forum comment text, we propose to use Character-level Convolutional Networks (Char-CNN) to capture these special information. Finally, the semantic and structural information learned by the semantic and structural extraction part is merged with the character information learned by Char-CNN, and the attention mechanism to learn their weights, the final representation of the sentence can be obtained. In our experiments, we achieve urgent posts classification with a micro F-score of 91.8%, 91.3% and 88.4% on the Stanford MOOCPosts dataset, outperforming the state-of-the-art approach by 1.8%, 2.4% and 1.5% respectively. This work can help teachers prioritize their responses and better manage numerous posts. Teachers can answer learner questions in a timely manner and help reduce dropout rates and improve completion rates.
topic MOOC
urgent posts
convolutional neural network
gated recurrent unit
semantic information and structural information
intervention learning
url https://ieeexplore.ieee.org/document/8764349/
work_keys_str_mv AT shouxiguo attentionbasedcharacterwordhybridneuralnetworkswithsemanticandstructuralinformationforidentifyingofurgentpostsinmoocdiscussionforums
AT xiasun attentionbasedcharacterwordhybridneuralnetworkswithsemanticandstructuralinformationforidentifyingofurgentpostsinmoocdiscussionforums
AT shixiongwang attentionbasedcharacterwordhybridneuralnetworkswithsemanticandstructuralinformationforidentifyingofurgentpostsinmoocdiscussionforums
AT yigao attentionbasedcharacterwordhybridneuralnetworkswithsemanticandstructuralinformationforidentifyingofurgentpostsinmoocdiscussionforums
AT junfeng attentionbasedcharacterwordhybridneuralnetworkswithsemanticandstructuralinformationforidentifyingofurgentpostsinmoocdiscussionforums
_version_ 1721539773822140416