Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification

Though great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for pe...

Full description

Bibliographic Details
Main Authors: Hanqian Wu, Zhike Wang, Feng Qing, Shoushan Li
Format: Article
Language:English
Published: MDPI AG 2021-01-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/3/270
id doaj-f092a495c14147119dff6d3cf007ea92
record_format Article
spelling doaj-f092a495c14147119dff6d3cf007ea922021-01-24T00:02:54ZengMDPI AGElectronics2079-92922021-01-011027027010.3390/electronics10030270Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment ClassificationHanqian Wu0Zhike Wang1Feng Qing2Shoushan Li3School of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaSchool of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaSchool of Computer Science and Engineering, Southeast University, Nanjing 210000, ChinaNLP Lab, School of Computer Science and Technology, Soochow University, Suzhou 215000, ChinaThough great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for performing a Cross-Lingual Aspect Sentiment Classification (CLASC) task which leverages the rich resources in one language (source language) for aspect sentiment classification in a under-resourced language (target language). Specifically, we first build a bilingual lexicon for domain-specific training data to translate the aspect category annotated in the source-language corpus and then translate sentences from the source language to the target language via Machine Translation (MT) tools. However, most MT systems are general-purpose, it non-avoidably introduces translation ambiguities which would degrade the performance of CLASC. In this context, we propose a novel approach called Reinforced Transformer with Cross-Lingual Distillation (RTCLD) combined with target-sensitive adversarial learning to minimize the undesirable effects of translation ambiguities in sentence translation. We conduct experiments on different language combinations, treating English as the source language and Chinese, Russian, and Spanish as target languages. The experimental results show that our proposed approach outperforms the state-of-the-art methods on different target languages.https://www.mdpi.com/2079-9292/10/3/270cross-lingual aspect sentiment classificationreinforced transformeradversarial learning
collection DOAJ
language English
format Article
sources DOAJ
author Hanqian Wu
Zhike Wang
Feng Qing
Shoushan Li
spellingShingle Hanqian Wu
Zhike Wang
Feng Qing
Shoushan Li
Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
Electronics
cross-lingual aspect sentiment classification
reinforced transformer
adversarial learning
author_facet Hanqian Wu
Zhike Wang
Feng Qing
Shoushan Li
author_sort Hanqian Wu
title Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
title_short Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
title_full Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
title_fullStr Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
title_full_unstemmed Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification
title_sort reinforced transformer with cross-lingual distillation for cross-lingual aspect sentiment classification
publisher MDPI AG
series Electronics
issn 2079-9292
publishDate 2021-01-01
description Though great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for performing a Cross-Lingual Aspect Sentiment Classification (CLASC) task which leverages the rich resources in one language (source language) for aspect sentiment classification in a under-resourced language (target language). Specifically, we first build a bilingual lexicon for domain-specific training data to translate the aspect category annotated in the source-language corpus and then translate sentences from the source language to the target language via Machine Translation (MT) tools. However, most MT systems are general-purpose, it non-avoidably introduces translation ambiguities which would degrade the performance of CLASC. In this context, we propose a novel approach called Reinforced Transformer with Cross-Lingual Distillation (RTCLD) combined with target-sensitive adversarial learning to minimize the undesirable effects of translation ambiguities in sentence translation. We conduct experiments on different language combinations, treating English as the source language and Chinese, Russian, and Spanish as target languages. The experimental results show that our proposed approach outperforms the state-of-the-art methods on different target languages.
topic cross-lingual aspect sentiment classification
reinforced transformer
adversarial learning
url https://www.mdpi.com/2079-9292/10/3/270
work_keys_str_mv AT hanqianwu reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification
AT zhikewang reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification
AT fengqing reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification
AT shoushanli reinforcedtransformerwithcrosslingualdistillationforcrosslingualaspectsentimentclassification
_version_ 1724326878130470912