Estimating Subjective Argument Quality Aspects From Social Signals in Argumentative Dialogue Systems

• Main Authors: Niklas Rach, Yuki Matsuda, Stefan Ultes, Wolfgang Minker, Keiichi Yasumoto
• Format: Article
• Language: English
• Published: IEEE 2021-01-01
• Series: IEEE Access
• Subjects: Computational argumentation; argument quality estimation; argumentative dialogue systems; social signal extraction; machine learning
• Online Access: https://ieeexplore.ieee.org/document/9321384/
• ISSN: 2169-3536

Information about a subjective user opinion towards an argument is crucial for argumentative systems in order to present appropriate content and adapt their behaviour to the individual user. However, requesting explicit feedback regarding the discussed arguments is often impractical and can hinder the interaction. To address this issue, we investigate the automatic recognition of user opinions towards arguments that are presented by means of a virtual avatar from social signals. We focus on two different user opinion categories (convincing and interesting) and two different types of social signals (facial expressions and eye movement). The recognition is addressed as a supervised learning problem and realized using the argument search evaluation data discussed in previous work. The overall performance is compared to a human annotation on a subset of the collected data. The results show that the machine learning performance is similar to human performance in both recognition tasks.