Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning
This research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a con...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-06-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/10/12/4234 |
id |
doaj-6699a4389ede4caf92e8bee51d959057 |
---|---|
record_format |
Article |
spelling |
doaj-6699a4389ede4caf92e8bee51d9590572020-11-25T03:30:19ZengMDPI AGApplied Sciences2076-34172020-06-01104234423410.3390/app10124234Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer LearningHung-Kai Kung0Chun-Mo Hsieh1Cheng-Yu Ho2Yun-Cheng Tsai3Hao-Yung Chan4Meng-Han Tsai5Department of Geography, National Taiwan University, Taipei 10617, TaiwanDepartment of Economics, National Taiwan University, Taipei 10617, TaiwanDepartment of Geography, National Taiwan University, Taipei 10617, TaiwanSchool of Big Data Management, Soochow University, Taipei 111002, TaiwanDepartment of Civil and Construction Engineering, National Taiwan University of Science and Technology, Taipei 10607, TaiwanDepartment of Civil and Construction Engineering, National Taiwan University of Science and Technology, Taipei 10607, TaiwanThis research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a concise data set for disaster management; (2) reference model, which utilizes the bidirectional long short-term memory–conditional random field framework to implement NER; and (3) the augmented model built by integrating the first two modules via cross-domain transfer with disparate label sets. Through the combination of established rules and learned sentence patterns, the hybrid approach performs well in NER tasks for disaster management and recognizes unfamiliar words successfully. This research applied the proposed NER module to disaster management. In the application, we favorably handled the NER tasks of our related work and achieved our desired outcomes. Through proper transfer, the results of this work can be extended to other fields and consequently bring valuable advantages in diverse applications.https://www.mdpi.com/2076-3417/10/12/4234damage information gatheringdisaster managementdata augmentationtransfer learningnamed entity recognitionchatbot |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hung-Kai Kung Chun-Mo Hsieh Cheng-Yu Ho Yun-Cheng Tsai Hao-Yung Chan Meng-Han Tsai |
spellingShingle |
Hung-Kai Kung Chun-Mo Hsieh Cheng-Yu Ho Yun-Cheng Tsai Hao-Yung Chan Meng-Han Tsai Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning Applied Sciences damage information gathering disaster management data augmentation transfer learning named entity recognition chatbot |
author_facet |
Hung-Kai Kung Chun-Mo Hsieh Cheng-Yu Ho Yun-Cheng Tsai Hao-Yung Chan Meng-Han Tsai |
author_sort |
Hung-Kai Kung |
title |
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning |
title_short |
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning |
title_full |
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning |
title_fullStr |
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning |
title_full_unstemmed |
Data-Augmented Hybrid Named Entity Recognition for Disaster Management by Transfer Learning |
title_sort |
data-augmented hybrid named entity recognition for disaster management by transfer learning |
publisher |
MDPI AG |
series |
Applied Sciences |
issn |
2076-3417 |
publishDate |
2020-06-01 |
description |
This research aims to build a Mandarin named entity recognition (NER) module using transfer learning to facilitate damage information gathering and analysis in disaster management. The hybrid NER approach proposed in this research includes three modules: (1) data augmentation, which constructs a concise data set for disaster management; (2) reference model, which utilizes the bidirectional long short-term memory–conditional random field framework to implement NER; and (3) the augmented model built by integrating the first two modules via cross-domain transfer with disparate label sets. Through the combination of established rules and learned sentence patterns, the hybrid approach performs well in NER tasks for disaster management and recognizes unfamiliar words successfully. This research applied the proposed NER module to disaster management. In the application, we favorably handled the NER tasks of our related work and achieved our desired outcomes. Through proper transfer, the results of this work can be extended to other fields and consequently bring valuable advantages in diverse applications. |
topic |
damage information gathering disaster management data augmentation transfer learning named entity recognition chatbot |
url |
https://www.mdpi.com/2076-3417/10/12/4234 |
work_keys_str_mv |
AT hungkaikung dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning AT chunmohsieh dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning AT chengyuho dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning AT yunchengtsai dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning AT haoyungchan dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning AT menghantsai dataaugmentedhybridnamedentityrecognitionfordisastermanagementbytransferlearning |
_version_ |
1724576228370808832 |