Structured prediction models for argumentative claim parsing from text

The internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, op...

Full description

Bibliographic Details
Main Authors: Filip Boltužić, Jan Šnajder
Format: Article
Language:English
Published: Taylor & Francis Group 2020-07-01
Series:Automatika
Subjects:
Online Access:http://dx.doi.org/10.1080/00051144.2020.1761101
id doaj-0b7f426ae77f4fbdb0c819614077ef58
record_format Article
spelling doaj-0b7f426ae77f4fbdb0c819614077ef582020-11-25T03:29:07ZengTaylor & Francis GroupAutomatika0005-11441848-33802020-07-0161336137010.1080/00051144.2020.17611011761101Structured prediction models for argumentative claim parsing from textFilip Boltužić0Jan Šnajder1Faculty of Electrical Engineering and Computing, University of ZagrebFaculty of Electrical Engineering and Computing, University of ZagrebThe internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, opinions are typically expressed as arguments, consisting of a set of claims endowed with internal semantic structure amenable to deeper analysis. In this article, we introduce the task of argumentative claim parsing (ACP), which aims at extracting semantic structures of claims from argumentative text. The task is split into two subtasks: claim segmentation and claim structuring. We present a new dataset on two discussion topics with claims manually annotated for both subtasks. Inspired by structured prediction approaches, we propose a number of supervised machine learning models for the ACP task, including deep learning, chain classifier, and joint learning models. Our experiments reveal that claim segmentation is a relatively feasible task, with the best-performing model achieving up to 0.37 and 0.79 exact and lenient macro-averaged F1-score, respectively. Claim structuring, however, proved to be a more challenging task, with the best-performing models achieving at most 0.08 macro-averaged F1-score.http://dx.doi.org/10.1080/00051144.2020.1761101opinion miningargumentation miningnatural language processingmachine learningdeep learningstructured prediction
collection DOAJ
language English
format Article
sources DOAJ
author Filip Boltužić
Jan Šnajder
spellingShingle Filip Boltužić
Jan Šnajder
Structured prediction models for argumentative claim parsing from text
Automatika
opinion mining
argumentation mining
natural language processing
machine learning
deep learning
structured prediction
author_facet Filip Boltužić
Jan Šnajder
author_sort Filip Boltužić
title Structured prediction models for argumentative claim parsing from text
title_short Structured prediction models for argumentative claim parsing from text
title_full Structured prediction models for argumentative claim parsing from text
title_fullStr Structured prediction models for argumentative claim parsing from text
title_full_unstemmed Structured prediction models for argumentative claim parsing from text
title_sort structured prediction models for argumentative claim parsing from text
publisher Taylor & Francis Group
series Automatika
issn 0005-1144
1848-3380
publishDate 2020-07-01
description The internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, opinions are typically expressed as arguments, consisting of a set of claims endowed with internal semantic structure amenable to deeper analysis. In this article, we introduce the task of argumentative claim parsing (ACP), which aims at extracting semantic structures of claims from argumentative text. The task is split into two subtasks: claim segmentation and claim structuring. We present a new dataset on two discussion topics with claims manually annotated for both subtasks. Inspired by structured prediction approaches, we propose a number of supervised machine learning models for the ACP task, including deep learning, chain classifier, and joint learning models. Our experiments reveal that claim segmentation is a relatively feasible task, with the best-performing model achieving up to 0.37 and 0.79 exact and lenient macro-averaged F1-score, respectively. Claim structuring, however, proved to be a more challenging task, with the best-performing models achieving at most 0.08 macro-averaged F1-score.
topic opinion mining
argumentation mining
natural language processing
machine learning
deep learning
structured prediction
url http://dx.doi.org/10.1080/00051144.2020.1761101
work_keys_str_mv AT filipboltuzic structuredpredictionmodelsforargumentativeclaimparsingfromtext
AT jansnajder structuredpredictionmodelsforargumentativeclaimparsingfromtext
_version_ 1724580452117774336