Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
In light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpreta...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9083954/ |
id |
doaj-5c1b1c81bec64429b74453052eb5a48a |
---|---|
record_format |
Article |
spelling |
doaj-5c1b1c81bec64429b74453052eb5a48a2021-03-30T02:25:42ZengIEEEIEEE Access2169-35362020-01-018853488535810.1109/ACCESS.2020.29912579083954Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent MiningKai Yang0https://orcid.org/0000-0002-3340-9377Xinyu Kong1https://orcid.org/0000-0001-5371-1947Yafang Wang2https://orcid.org/0000-0003-0158-6210Jie Zhang3https://orcid.org/0000-0001-6331-4005Gerard De Melo4https://orcid.org/0000-0002-2930-2059Ant Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaDepartment of Computer Science, Rutgers, The State University of New Jersey, Piscataway, NJ, USAIn light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpretable basis for the classification. To address this, we propose a scheme to interpret the intent in multi-turn dialogue based on specific characteristics of the dialogue text. We rely on policy-guided reinforcement learning to identify paths in a graph to confirm concrete paths of inference that serve as interpretable explanations. The graph is induced based on the multi-turn dialogue user utterances, the intents, i.e., standard queries of the dialogues, and the sub-intents associated with the dialogues. Our reinforcement learning method then discerns the characteristics of the dialogue in chronological order as the basis for multi-turn dialogue path selection. Finally, we consider a wide range of recently proposed knowledge graph-based recommender systems as baselines, mostly based on deep reinforcement learning and our method performs best.https://ieeexplore.ieee.org/document/9083954/Knowledge graphdialogue intent miningreinforcement learning |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Kai Yang Xinyu Kong Yafang Wang Jie Zhang Gerard De Melo |
spellingShingle |
Kai Yang Xinyu Kong Yafang Wang Jie Zhang Gerard De Melo Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining IEEE Access Knowledge graph dialogue intent mining reinforcement learning |
author_facet |
Kai Yang Xinyu Kong Yafang Wang Jie Zhang Gerard De Melo |
author_sort |
Kai Yang |
title |
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining |
title_short |
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining |
title_full |
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining |
title_fullStr |
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining |
title_full_unstemmed |
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining |
title_sort |
reinforcement learning over knowledge graphs for explainable dialogue intent mining |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
In light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpretable basis for the classification. To address this, we propose a scheme to interpret the intent in multi-turn dialogue based on specific characteristics of the dialogue text. We rely on policy-guided reinforcement learning to identify paths in a graph to confirm concrete paths of inference that serve as interpretable explanations. The graph is induced based on the multi-turn dialogue user utterances, the intents, i.e., standard queries of the dialogues, and the sub-intents associated with the dialogues. Our reinforcement learning method then discerns the characteristics of the dialogue in chronological order as the basis for multi-turn dialogue path selection. Finally, we consider a wide range of recently proposed knowledge graph-based recommender systems as baselines, mostly based on deep reinforcement learning and our method performs best. |
topic |
Knowledge graph dialogue intent mining reinforcement learning |
url |
https://ieeexplore.ieee.org/document/9083954/ |
work_keys_str_mv |
AT kaiyang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining AT xinyukong reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining AT yafangwang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining AT jiezhang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining AT gerarddemelo reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining |
_version_ |
1724185184091242496 |