Investigation of text data augmentation for transformer training via translation technique

Data augmentation can improve model’s final accuracy by introducing new data samples to the dataset. In this paper, text data augmentation using translation technique is investigated. Synthetic translations, generated by Opus-MT model are compared to the unique foreign data samples in terms of an i...

Full description

Bibliographic Details
Main Author: Dominykas Šeputis
Format: Article
Language:English
Published: Vilnius University Press 2021-05-01
Series:Vilnius University Open Series
Subjects:
Online Access:https://www.zurnalai.vu.lt/open-series/article/view/24036
Description
Summary:Data augmentation can improve model’s final accuracy by introducing new data samples to the dataset. In this paper, text data augmentation using translation technique is investigated. Synthetic translations, generated by Opus-MT model are compared to the unique foreign data samples in terms of an impact to the trans- former network-based models’ performance. The experimental results showed that multilingual models like DistilBERT in some cases benefit from the introduction of the addition artificially created data samples presented in a foreign language.
ISSN:2669-0535