Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
Though great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for pe...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-01-01
|
Series: | Electronics |
Subjects: | |
Online Access: | https://www.mdpi.com/2079-9292/10/3/270 |
id |
doaj-f092a495c14147119dff6d3cf007ea92 |
---|---|
record_format |
Article |
spelling |
doaj-f092a495c14147119dff6d3cf007ea922021-01-24T00:02:54ZengMDPI AGElectronics2079-92922021-01-011027027010.3390/electronics10030270Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment ClassificationHanqian Wu0Zhike Wang1Feng Qing2Shoushan Li3School of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaSchool of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaSchool of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaNLP Lab, School of Computer Science and Technology, Soochow University, Suzhou 215000, ChinaThough great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for performing a Cross-Lingual Aspect Sentiment Classification (CLASC) task which leverages the rich resources in one language (source language) for aspect sentiment classification in a under-resourced language (target language). Specifically, we first build a bilingual lexicon for domain-specific training data to translate the aspect category annotated in the source-language corpus and then translate sentences from the source language to the target language via Machine Translation (MT) tools. However, most MT systems are general-purpose, it non-avoidably introduces translation ambiguities which would degrade the performance of CLASC. In this context, we propose a novel approach called Reinforced Transformer with Cross-Lingual Distillation (RTCLD) combined with target-sensitive adversarial learning to minimize the undesirable effects of translation ambiguities in sentence translation. We conduct experiments on different language combinations, treating English as the source language and Chinese, Russian, and Spanish as target languages. The experimental results show that our proposed approach outperforms the state-of-the-art methods on different target languages.https://www.mdpi.com/2079-9292/10/3/270cross-lingual aspect sentiment classificationreinforced transformeradversarial learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hanqian Wu Zhike Wang Feng Qing Shoushan Li |
spellingShingle |
Hanqian Wu Zhike Wang Feng Qing Shoushan Li Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification Electronics cross-lingual aspect sentiment classification reinforced transformer adversarial learning |
author_facet |
Hanqian Wu Zhike Wang Feng Qing Shoushan Li |
author_sort |
Hanqian Wu |
title |
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification |
title_short |
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification |
title_full |
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification |
title_fullStr |
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification |
title_full_unstemmed |
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification |
title_sort |
reinforced transformer with cross-lingual distillation for cross-lingual aspect sentiment classification |
publisher |
MDPI AG |
series |
Electronics |
issn |
2079-9292 |
publishDate |
2021-01-01 |
description |
Though great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for performing a Cross-Lingual Aspect Sentiment Classification (CLASC) task which leverages the rich resources in one language (source language) for aspect sentiment classification in a under-resourced language (target language). Specifically, we first build a bilingual lexicon for domain-specific training data to translate the aspect category annotated in the source-language corpus and then translate sentences from the source language to the target language via Machine Translation (MT) tools. However, most MT systems are general-purpose, it non-avoidably introduces translation ambiguities which would degrade the performance of CLASC. In this context, we propose a novel approach called Reinforced Transformer with Cross-Lingual Distillation (RTCLD) combined with target-sensitive adversarial learning to minimize the undesirable effects of translation ambiguities in sentence translation. We conduct experiments on different language combinations, treating English as the source language and Chinese, Russian, and Spanish as target languages. The experimental results show that our proposed approach outperforms the state-of-the-art methods on different target languages. |
topic |
cross-lingual aspect sentiment classification reinforced transformer adversarial learning |
url |
https://www.mdpi.com/2079-9292/10/3/270 |
work_keys_str_mv |
AT hanqianwu reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification AT zhikewang reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification AT fengqing reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification AT shoushanli reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification |
_version_ |
1724326878130470912 |