The Attribute Extraction of Freeway Event Texts Using Neural Network
碩士 === 國立交通大學 === 網路工程研究所 === 106 === Specific traffic event attributes can be used to develop computer applications, such as vehicle navigation and traffic prediction. However, most of today's traffic event messages are in text format, whose attributes are not clearly specified. The test messa...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Others |
Language: | zh-TW |
Published: |
2018
|
Online Access: | http://ndltd.ncl.edu.tw/handle/htvb72 |
id |
ndltd-TW-106NCTU5726020 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TW-106NCTU57260202019-09-26T03:28:10Z http://ndltd.ncl.edu.tw/handle/htvb72 The Attribute Extraction of Freeway Event Texts Using Neural Network 應用類神經網路擷取國道事件訊息屬性 Liu, Kuo-Yuan 留國源 碩士 國立交通大學 網路工程研究所 106 Specific traffic event attributes can be used to develop computer applications, such as vehicle navigation and traffic prediction. However, most of today's traffic event messages are in text format, whose attributes are not clearly specified. The test messages must be analyzed to extract all attributes, such as event types, involved vehicles, affected lanes, etc. Our goal is to extract the attributes of traffic events from traffic test messages published by transportation bureau and radio stations. This thesis presents the use of neural networks to extract freeway event attributes. We first developed the regular expression to extract and tag the attributes of each word of the text messages. Since the traffic text messages do not follow specific syntaxes, using regular expression cannot tag the attributes with 100% correctness. Then, we used neural network models, namely, LSTM, BLSTM, and our proposed window model to tag the attribute of each Chinese character of the text messages. The results obtained by the neural network models can be compared with the results of regular expression. If the two are inconsistent and we can determine which is incorrect. The determination must be done by human, and the results can be used to modify regular expressions to improve its tagging correctness. . For the dataset of traffic event text message published by NFB, our window model achieves the same correct tagging rate as BLSTM. The F1 score is 99.99. For the dataset of traffic event text message published by PBS, BLSTM provides the highest correct tagging rate; The F1 score is 99.63. In comparison, the F1 score of the window model is 99.57. The more training data, the larger embedding dimension, the higher F1 score one can get. Using separate embedding table for each location of the characters in the window model also improve the F1 score by 0.11. Compared with the regular expression, the neural network models can handle more complex syntax structure, and have higher correct tagging rate. Chang, Ming-Feng 張明峰 2018 學位論文 ; thesis 30 zh-TW |
collection |
NDLTD |
language |
zh-TW |
format |
Others
|
sources |
NDLTD |
description |
碩士 === 國立交通大學 === 網路工程研究所 === 106 === Specific traffic event attributes can be used to develop computer applications, such as vehicle navigation and traffic prediction. However, most of today's traffic event messages are in text format, whose attributes are not clearly specified. The test messages must be analyzed to extract all attributes, such as event types, involved vehicles, affected lanes, etc. Our goal is to extract the attributes of traffic events from traffic test messages published by transportation bureau and radio stations.
This thesis presents the use of neural networks to extract freeway event attributes. We first developed the regular expression to extract and tag the attributes of each word of the text messages. Since the traffic text messages do not follow specific syntaxes, using regular expression cannot tag the attributes with 100% correctness. Then, we used neural network models, namely, LSTM, BLSTM, and our proposed window model to tag the attribute of each Chinese character of the text messages. The results obtained by the neural network models can be compared with the results of regular expression. If the two are inconsistent and we can determine which is incorrect. The determination must be done by human, and the results can be used to modify regular expressions to improve its tagging correctness.
. For the dataset of traffic event text message published by NFB, our window model achieves the same correct tagging rate as BLSTM. The F1 score is 99.99. For the dataset of traffic event text message published by PBS, BLSTM provides the highest correct tagging rate; The F1 score is 99.63. In comparison, the F1 score of the window model is 99.57. The more training data, the larger embedding dimension, the higher F1 score one can get. Using separate embedding table for each location of the characters in the window model also improve the F1 score by 0.11. Compared with the regular expression, the neural network models can handle more complex syntax structure, and have higher correct tagging rate.
|
author2 |
Chang, Ming-Feng |
author_facet |
Chang, Ming-Feng Liu, Kuo-Yuan 留國源 |
author |
Liu, Kuo-Yuan 留國源 |
spellingShingle |
Liu, Kuo-Yuan 留國源 The Attribute Extraction of Freeway Event Texts Using Neural Network |
author_sort |
Liu, Kuo-Yuan |
title |
The Attribute Extraction of Freeway Event Texts Using Neural Network |
title_short |
The Attribute Extraction of Freeway Event Texts Using Neural Network |
title_full |
The Attribute Extraction of Freeway Event Texts Using Neural Network |
title_fullStr |
The Attribute Extraction of Freeway Event Texts Using Neural Network |
title_full_unstemmed |
The Attribute Extraction of Freeway Event Texts Using Neural Network |
title_sort |
attribute extraction of freeway event texts using neural network |
publishDate |
2018 |
url |
http://ndltd.ncl.edu.tw/handle/htvb72 |
work_keys_str_mv |
AT liukuoyuan theattributeextractionoffreewayeventtextsusingneuralnetwork AT liúguóyuán theattributeextractionoffreewayeventtextsusingneuralnetwork AT liukuoyuan yīngyònglèishénjīngwǎnglùxiéqǔguódàoshìjiànxùnxīshǔxìng AT liúguóyuán yīngyònglèishénjīngwǎnglùxiéqǔguódàoshìjiànxùnxīshǔxìng AT liukuoyuan attributeextractionoffreewayeventtextsusingneuralnetwork AT liúguóyuán attributeextractionoffreewayeventtextsusingneuralnetwork |
_version_ |
1719257747431620608 |