Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home

When we develop voice-activated human-appliance interface systems in smart homes, named entity recognition (NER) is an essential tool for extracting execution targets from natural language commands. Previous studies on NER systems generally include supervised machine-learning methods that require a...

Full description

Bibliographic Details
Main Authors: Geonwoo Park, Harksoo Kim
Format: Article
Language:English
Published: MDPI AG 2018-02-01
Series:Sustainability
Subjects:
Online Access:http://www.mdpi.com/2071-1050/10/2/488
id doaj-23c691701be34f84a6f7318467d7dfc2
record_format Article
spelling doaj-23c691701be34f84a6f7318467d7dfc22020-11-24T22:10:05ZengMDPI AGSustainability2071-10502018-02-0110248810.3390/su10020488su10020488Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart HomeGeonwoo Park0Harksoo Kim1Program of Computer and Communications Engineering, Kangwon National University, Chuncheon-si 24341, KoreaProgram of Computer and Communications Engineering, Kangwon National University, Chuncheon-si 24341, KoreaWhen we develop voice-activated human-appliance interface systems in smart homes, named entity recognition (NER) is an essential tool for extracting execution targets from natural language commands. Previous studies on NER systems generally include supervised machine-learning methods that require a substantial amount of human-annotated training corpus. In the smart home environment, categories of named entities should be defined according to voice-activated devices (e.g., food names for refrigerators and song titles for music players). The previous machine-learning methods make it difficult to change categories of named entities because a large amount of the training corpus should be newly constructed by hand. To address this problem, we present a semi-supervised NER system to minimize the time-consuming and labor-intensive task of constructing the training corpus. Our system uses distant supervision methods with two kinds of auto-labeling processes: auto-labeling based on heuristic rules for single-class named entity corpus generation and auto-labeling based on a pre-trained single-class NER model for multi-class named entity corpus generation. Then, our system improves NER accuracy by using a bagging-based active learning method. In our experiments that included a generic domain that featured 11 named entity classes and a context-specific domain about baseball that featured 21 named entity classes, our system demonstrated good performances in both domains, with F1-measures of 0.777 and 0.958, respectively. Since our system was built from a relatively small human-annotated training corpus, we believe it is a viable alternative to current NER systems in smart home environments.http://www.mdpi.com/2071-1050/10/2/488human-appliance interface systemnamed entity recognitionbagging-based active learningdistant supervisionlow-cost implementation
collection DOAJ
language English
format Article
sources DOAJ
author Geonwoo Park
Harksoo Kim
spellingShingle Geonwoo Park
Harksoo Kim
Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
Sustainability
human-appliance interface system
named entity recognition
bagging-based active learning
distant supervision
low-cost implementation
author_facet Geonwoo Park
Harksoo Kim
author_sort Geonwoo Park
title Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
title_short Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
title_full Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
title_fullStr Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
title_full_unstemmed Low-Cost Implementation of a Named Entity Recognition System for Voice-Activated Human-Appliance Interfaces in a Smart Home
title_sort low-cost implementation of a named entity recognition system for voice-activated human-appliance interfaces in a smart home
publisher MDPI AG
series Sustainability
issn 2071-1050
publishDate 2018-02-01
description When we develop voice-activated human-appliance interface systems in smart homes, named entity recognition (NER) is an essential tool for extracting execution targets from natural language commands. Previous studies on NER systems generally include supervised machine-learning methods that require a substantial amount of human-annotated training corpus. In the smart home environment, categories of named entities should be defined according to voice-activated devices (e.g., food names for refrigerators and song titles for music players). The previous machine-learning methods make it difficult to change categories of named entities because a large amount of the training corpus should be newly constructed by hand. To address this problem, we present a semi-supervised NER system to minimize the time-consuming and labor-intensive task of constructing the training corpus. Our system uses distant supervision methods with two kinds of auto-labeling processes: auto-labeling based on heuristic rules for single-class named entity corpus generation and auto-labeling based on a pre-trained single-class NER model for multi-class named entity corpus generation. Then, our system improves NER accuracy by using a bagging-based active learning method. In our experiments that included a generic domain that featured 11 named entity classes and a context-specific domain about baseball that featured 21 named entity classes, our system demonstrated good performances in both domains, with F1-measures of 0.777 and 0.958, respectively. Since our system was built from a relatively small human-annotated training corpus, we believe it is a viable alternative to current NER systems in smart home environments.
topic human-appliance interface system
named entity recognition
bagging-based active learning
distant supervision
low-cost implementation
url http://www.mdpi.com/2071-1050/10/2/488
work_keys_str_mv AT geonwoopark lowcostimplementationofanamedentityrecognitionsystemforvoiceactivatedhumanapplianceinterfacesinasmarthome
AT harksookim lowcostimplementationofanamedentityrecognitionsystemforvoiceactivatedhumanapplianceinterfacesinasmarthome
_version_ 1725809428608843776