Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances

Relation classification (RC) is an important task in information extraction from unstructured text. Recently, several neural methods based on various network architectures have been adopted for the task of RC. Among them, convolution neural network (CNN)-based models stand out due to their simple st...

Full description

Bibliographic Details
Main Authors: Zhen Tan, Bo Li, Peixin Huang, Bin Ge, Weidong Xiao
Format: Article
Language:English
Published: MDPI AG 2018-08-01
Series:Symmetry
Subjects:
Online Access:http://www.mdpi.com/2073-8994/10/9/357
id doaj-bb0872499e1d490fb06491735778b3ab
record_format Article
spelling doaj-bb0872499e1d490fb06491735778b3ab2020-11-25T00:11:04ZengMDPI AGSymmetry2073-89942018-08-0110935710.3390/sym10090357sym10090357Neural Relation Classification Using Selective Attention and Symmetrical Directional InstancesZhen Tan0Bo Li1Peixin Huang2Bin Ge3Weidong Xiao4Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaScience and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaScience and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaScience and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaScience and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaRelation classification (RC) is an important task in information extraction from unstructured text. Recently, several neural methods based on various network architectures have been adopted for the task of RC. Among them, convolution neural network (CNN)-based models stand out due to their simple structure, low model complexity and “good” performance. Nevertheless, there are still at least two limitations associated with existing CNN-based RC models. First, when handling samples with long distances between entities, they fail to extract effective features, even obtaining disturbing ones from the clauses, which results in decreased accuracy. Second, existing RC models tend to produce inconsistent results when fed with forward and backward instances of an identical sample. Therefore, we present a novel CNN-based sentence encoder with selective attention by leveraging the shortest dependency paths, and devise a classification framework using symmetrical directional—forward and backward—instances via information fusion. Comprehensive experiments verify the superior performance of the proposed RC model over mainstream competitors without additional artificial features.http://www.mdpi.com/2073-8994/10/9/357relation extractionselect attentionsymmetrical directional instancesinformation fusion
collection DOAJ
language English
format Article
sources DOAJ
author Zhen Tan
Bo Li
Peixin Huang
Bin Ge
Weidong Xiao
spellingShingle Zhen Tan
Bo Li
Peixin Huang
Bin Ge
Weidong Xiao
Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
Symmetry
relation extraction
select attention
symmetrical directional instances
information fusion
author_facet Zhen Tan
Bo Li
Peixin Huang
Bin Ge
Weidong Xiao
author_sort Zhen Tan
title Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
title_short Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
title_full Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
title_fullStr Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
title_full_unstemmed Neural Relation Classification Using Selective Attention and Symmetrical Directional Instances
title_sort neural relation classification using selective attention and symmetrical directional instances
publisher MDPI AG
series Symmetry
issn 2073-8994
publishDate 2018-08-01
description Relation classification (RC) is an important task in information extraction from unstructured text. Recently, several neural methods based on various network architectures have been adopted for the task of RC. Among them, convolution neural network (CNN)-based models stand out due to their simple structure, low model complexity and “good” performance. Nevertheless, there are still at least two limitations associated with existing CNN-based RC models. First, when handling samples with long distances between entities, they fail to extract effective features, even obtaining disturbing ones from the clauses, which results in decreased accuracy. Second, existing RC models tend to produce inconsistent results when fed with forward and backward instances of an identical sample. Therefore, we present a novel CNN-based sentence encoder with selective attention by leveraging the shortest dependency paths, and devise a classification framework using symmetrical directional—forward and backward—instances via information fusion. Comprehensive experiments verify the superior performance of the proposed RC model over mainstream competitors without additional artificial features.
topic relation extraction
select attention
symmetrical directional instances
information fusion
url http://www.mdpi.com/2073-8994/10/9/357
work_keys_str_mv AT zhentan neuralrelationclassificationusingselectiveattentionandsymmetricaldirectionalinstances
AT boli neuralrelationclassificationusingselectiveattentionandsymmetricaldirectionalinstances
AT peixinhuang neuralrelationclassificationusingselectiveattentionandsymmetricaldirectionalinstances
AT binge neuralrelationclassificationusingselectiveattentionandsymmetricaldirectionalinstances
AT weidongxiao neuralrelationclassificationusingselectiveattentionandsymmetricaldirectionalinstances
_version_ 1725405404873097216