Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning

This research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a con...

Full description

Bibliographic Details
Main Authors: Hung-Kai Kung, Chun-Mo Hsieh, Cheng-Yu Ho, Yun-Cheng Tsai, Hao-Yung Chan, Meng-Han Tsai
Format: Article
Language:English
Published: MDPI AG 2020-06-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/12/4234
id doaj-6699a4389ede4caf92e8bee51d959057
record_format Article
spelling doaj-6699a4389ede4caf92e8bee51d9590572020-11-25T03:30:19ZengMDPI AGApplied Sciences2076-34172020-06-01104234423410.3390/app10124234Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer LearningHung-Kai Kung0Chun-Mo Hsieh1Cheng-Yu Ho2Yun-Cheng Tsai3Hao-Yung Chan4Meng-Han Tsai5Department of Geography, National Taiwan University, Taipei 10617, TaiwanDepartment of Economics, National Taiwan University, Taipei 10617, TaiwanDepartment of Geography, National Taiwan University, Taipei 10617, TaiwanSchool of Big Data Management, Soochow University, Taipei 111002, TaiwanDepartment of Civil and Construction Engineering, National Taiwan University of Science and Technology, Taipei 10607, TaiwanDepartment of Civil and Construction Engineering, National Taiwan University of Science and Technology, Taipei 10607, TaiwanThis research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a concise data set for disaster management; (2) reference model, which utilizes the bidirectional long short-term memory–conditional random field framework to implement NER; and (3) the augmented model built by integrating the first two modules via cross-domain transfer with disparate label sets. Through the combination of established rules and learned sentence patterns, the hybrid approach performs well in NER tasks for disaster management and recognizes unfamiliar words successfully. This research applied the proposed NER module to disaster management. In the application, we favorably handled the NER tasks of our related work and achieved our desired outcomes. Through proper transfer, the results of this work can be extended to other fields and consequently bring valuable advantages in diverse applications.https://www.mdpi.com/2076-3417/10/12/4234damage information gatheringdisaster managementdata augmentationtransfer learningnamed entity recognitionchatbot
collection DOAJ
language English
format Article
sources DOAJ
author Hung-Kai Kung
Chun-Mo Hsieh
Cheng-Yu Ho
Yun-Cheng Tsai
Hao-Yung Chan
Meng-Han Tsai
spellingShingle Hung-Kai Kung
Chun-Mo Hsieh
Cheng-Yu Ho
Yun-Cheng Tsai
Hao-Yung Chan
Meng-Han Tsai
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
Applied Sciences
damage information gathering
disaster management
data augmentation
transfer learning
named entity recognition
chatbot
author_facet Hung-Kai Kung
Chun-Mo Hsieh
Cheng-Yu Ho
Yun-Cheng Tsai
Hao-Yung Chan
Meng-Han Tsai
author_sort Hung-Kai Kung
title Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
title_short Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
title_full Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
title_fullStr Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
title_full_unstemmed Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
title_sort data-augmented hybrid named entity recognition for disaster management by transfer learning
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2020-06-01
description This research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a concise data set for disaster management; (2) reference model, which utilizes the bidirectional long short-term memory–conditional random field framework to implement NER; and (3) the augmented model built by integrating the first two modules via cross-domain transfer with disparate label sets. Through the combination of established rules and learned sentence patterns, the hybrid approach performs well in NER tasks for disaster management and recognizes unfamiliar words successfully. This research applied the proposed NER module to disaster management. In the application, we favorably handled the NER tasks of our related work and achieved our desired outcomes. Through proper transfer, the results of this work can be extended to other fields and consequently bring valuable advantages in diverse applications.
topic damage information gathering
disaster management
data augmentation
transfer learning
named entity recognition
chatbot
url https://www.mdpi.com/2076-3417/10/12/4234
work_keys_str_mv AT hungkaikung dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
AT chunmohsieh dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
AT chengyuho dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
AT yunchengtsai dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
AT haoyungchan dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
AT menghantsai dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning
_version_ 1724576228370808832