Structured prediction models for argumentative claim parsing from text
The internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, op...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Taylor & Francis Group
2020-07-01
|
Series: | Automatika |
Subjects: | |
Online Access: | http://dx.doi.org/10.1080/00051144.2020.1761101 |
id |
doaj-0b7f426ae77f4fbdb0c819614077ef58 |
---|---|
record_format |
Article |
spelling |
doaj-0b7f426ae77f4fbdb0c819614077ef582020-11-25T03:29:07ZengTaylor & Francis GroupAutomatika0005-11441848-33802020-07-0161336137010.1080/00051144.2020.17611011761101Structured prediction models for argumentative claim parsing from textFilip Boltužić0Jan Šnajder1Faculty of Electrical Engineering and Computing, University of ZagrebFaculty of Electrical Engineering and Computing, University of ZagrebThe internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, opinions are typically expressed as arguments, consisting of a set of claims endowed with internal semantic structure amenable to deeper analysis. In this article, we introduce the task of argumentative claim parsing (ACP), which aims at extracting semantic structures of claims from argumentative text. The task is split into two subtasks: claim segmentation and claim structuring. We present a new dataset on two discussion topics with claims manually annotated for both subtasks. Inspired by structured prediction approaches, we propose a number of supervised machine learning models for the ACP task, including deep learning, chain classifier, and joint learning models. Our experiments reveal that claim segmentation is a relatively feasible task, with the best-performing model achieving up to 0.37 and 0.79 exact and lenient macro-averaged F1-score, respectively. Claim structuring, however, proved to be a more challenging task, with the best-performing models achieving at most 0.08 macro-averaged F1-score.http://dx.doi.org/10.1080/00051144.2020.1761101opinion miningargumentation miningnatural language processingmachine learningdeep learningstructured prediction |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Filip Boltužić Jan Šnajder |
spellingShingle |
Filip Boltužić Jan Šnajder Structured prediction models for argumentative claim parsing from text Automatika opinion mining argumentation mining natural language processing machine learning deep learning structured prediction |
author_facet |
Filip Boltužić Jan Šnajder |
author_sort |
Filip Boltužić |
title |
Structured prediction models for argumentative claim parsing from text |
title_short |
Structured prediction models for argumentative claim parsing from text |
title_full |
Structured prediction models for argumentative claim parsing from text |
title_fullStr |
Structured prediction models for argumentative claim parsing from text |
title_full_unstemmed |
Structured prediction models for argumentative claim parsing from text |
title_sort |
structured prediction models for argumentative claim parsing from text |
publisher |
Taylor & Francis Group |
series |
Automatika |
issn |
0005-1144 1848-3380 |
publishDate |
2020-07-01 |
description |
The internet abounds with opinions expressed in text. While a number of natural language processing techniques have been proposed for opinion analysis from text, most offer only a shallow analysis without providing any insights into reasons supporting the opinions. In online discussions, however, opinions are typically expressed as arguments, consisting of a set of claims endowed with internal semantic structure amenable to deeper analysis. In this article, we introduce the task of argumentative claim parsing (ACP), which aims at extracting semantic structures of claims from argumentative text. The task is split into two subtasks: claim segmentation and claim structuring. We present a new dataset on two discussion topics with claims manually annotated for both subtasks. Inspired by structured prediction approaches, we propose a number of supervised machine learning models for the ACP task, including deep learning, chain classifier, and joint learning models. Our experiments reveal that claim segmentation is a relatively feasible task, with the best-performing model achieving up to 0.37 and 0.79 exact and lenient macro-averaged F1-score, respectively. Claim structuring, however, proved to be a more challenging task, with the best-performing models achieving at most 0.08 macro-averaged F1-score. |
topic |
opinion mining argumentation mining natural language processing machine learning deep learning structured prediction |
url |
http://dx.doi.org/10.1080/00051144.2020.1761101 |
work_keys_str_mv |
AT filipboltuzic structuredpredictionmodelsforargumentativeclaimparsingfromtext AT jansnajder structuredpredictionmodelsforargumentativeclaimparsingfromtext |
_version_ |
1724580452117774336 |