Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining

In light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpreta...

Full description

Bibliographic Details
Main Authors: Kai Yang, Xinyu Kong, Yafang Wang, Jie Zhang, Gerard De Melo
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9083954/
id doaj-5c1b1c81bec64429b74453052eb5a48a
record_format Article
spelling doaj-5c1b1c81bec64429b74453052eb5a48a2021-03-30T02:25:42ZengIEEEIEEE Access2169-35362020-01-018853488535810.1109/ACCESS.2020.29912579083954Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent MiningKai Yang0https://orcid.org/0000-0002-3340-9377Xinyu Kong1https://orcid.org/0000-0001-5371-1947Yafang Wang2https://orcid.org/0000-0003-0158-6210Jie Zhang3https://orcid.org/0000-0001-6331-4005Gerard De Melo4https://orcid.org/0000-0002-2930-2059Ant Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaAnt Financial Services Group, Hangzhou, ChinaDepartment of Computer Science, Rutgers, The State University of New Jersey, Piscataway, NJ, USAIn light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpretable basis for the classification. To address this, we propose a scheme to interpret the intent in multi-turn dialogue based on specific characteristics of the dialogue text. We rely on policy-guided reinforcement learning to identify paths in a graph to confirm concrete paths of inference that serve as interpretable explanations. The graph is induced based on the multi-turn dialogue user utterances, the intents, i.e., standard queries of the dialogues, and the sub-intents associated with the dialogues. Our reinforcement learning method then discerns the characteristics of the dialogue in chronological order as the basis for multi-turn dialogue path selection. Finally, we consider a wide range of recently proposed knowledge graph-based recommender systems as baselines, mostly based on deep reinforcement learning and our method performs best.https://ieeexplore.ieee.org/document/9083954/Knowledge graphdialogue intent miningreinforcement learning
collection DOAJ
language English
format Article
sources DOAJ
author Kai Yang
Xinyu Kong
Yafang Wang
Jie Zhang
Gerard De Melo
spellingShingle Kai Yang
Xinyu Kong
Yafang Wang
Jie Zhang
Gerard De Melo
Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
IEEE Access
Knowledge graph
dialogue intent mining
reinforcement learning
author_facet Kai Yang
Xinyu Kong
Yafang Wang
Jie Zhang
Gerard De Melo
author_sort Kai Yang
title Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
title_short Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
title_full Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
title_fullStr Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
title_full_unstemmed Reinforcement Learning Over Knowledge Graphs for Explainable Dialogue Intent Mining
title_sort reinforcement learning over knowledge graphs for explainable dialogue intent mining
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description In light of the millions of households that have adopted intelligent assistant powered devices, multi-turn dialogue has become an important field of inquiry. Most current methods identify the underlying intent in the dialogue using opaque classification techniques that fail to provide any interpretable basis for the classification. To address this, we propose a scheme to interpret the intent in multi-turn dialogue based on specific characteristics of the dialogue text. We rely on policy-guided reinforcement learning to identify paths in a graph to confirm concrete paths of inference that serve as interpretable explanations. The graph is induced based on the multi-turn dialogue user utterances, the intents, i.e., standard queries of the dialogues, and the sub-intents associated with the dialogues. Our reinforcement learning method then discerns the characteristics of the dialogue in chronological order as the basis for multi-turn dialogue path selection. Finally, we consider a wide range of recently proposed knowledge graph-based recommender systems as baselines, mostly based on deep reinforcement learning and our method performs best.
topic Knowledge graph
dialogue intent mining
reinforcement learning
url https://ieeexplore.ieee.org/document/9083954/
work_keys_str_mv AT kaiyang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining
AT xinyukong reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining
AT yafangwang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining
AT jiezhang reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining
AT gerarddemelo reinforcementlearningoverknowledgegraphsforexplainabledialogueintentmining
_version_ 1724185184091242496