A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching
In the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&a...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-06-01
|
Series: | Agronomy |
Subjects: | |
Online Access: | https://www.mdpi.com/2073-4395/11/7/1307 |
id |
doaj-9976d01493dd464b820d8ce2391084ac |
---|---|
record_format |
Article |
spelling |
doaj-9976d01493dd464b820d8ce2391084ac2021-07-23T13:26:18ZengMDPI AGAgronomy2073-43952021-06-01111307130710.3390/agronomy11071307A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity MatchingHaoriqin Wang0Huaji Zhu1Huarui Wu2Xiaomin Wang3Xiao Han4Tongyu Xu5College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaNational Engineering Research Center for Information Technology in Agriculture, Beijing 100097, ChinaCollege of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, ChinaIn the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&A system. To allow the fast and automatic detection of the same semantic rice-related questions, we propose a new method based on the Coattention-DenseGRU (Gated Recurrent Unit). According to the rice-related question characteristics, we applied word2vec with the TF-IDF (Term Frequency–Inverse Document Frequency) method to process and analyze the text data and compare it with the Word2vec, GloVe, and TF-IDF methods. Combined with the agricultural word segmentation dictionary, we applied Word2vec with the TF-IDF method, effectively solving the problem of high dimension and sparse data in the rice-related text. Each network layer employed the connection information of features and all previous recursive layers’ hidden features. To alleviate the problem of feature vector size increasing due to dense splicing, an autoencoder was used after dense concatenation. The experimental results show that rice-related question similarity matching based on Coattention-DenseGRU can improve the utilization of text features, reduce the loss of features, and achieve fast and accurate similarity matching of the rice-related question dataset. The precision and F1 values of the proposed model were 96.3% and 96.9%, respectively. Compared with seven other kinds of question similarity matching models, we present a new state-of-the-art method with our rice-related question dataset.https://www.mdpi.com/2073-4395/11/7/1307rice-related question similarity matchingnatural language processingdensely connected GRUcoattention mechanismquestion-and-answering communities |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Haoriqin Wang Huaji Zhu Huarui Wu Xiaomin Wang Xiao Han Tongyu Xu |
spellingShingle |
Haoriqin Wang Huaji Zhu Huarui Wu Xiaomin Wang Xiao Han Tongyu Xu A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching Agronomy rice-related question similarity matching natural language processing densely connected GRU coattention mechanism question-and-answering communities |
author_facet |
Haoriqin Wang Huaji Zhu Huarui Wu Xiaomin Wang Xiao Han Tongyu Xu |
author_sort |
Haoriqin Wang |
title |
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching |
title_short |
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching |
title_full |
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching |
title_fullStr |
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching |
title_full_unstemmed |
A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching |
title_sort |
densely connected gru neural network based on coattention mechanism for chinese rice-related question similarity matching |
publisher |
MDPI AG |
series |
Agronomy |
issn |
2073-4395 |
publishDate |
2021-06-01 |
description |
In the question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, thousands of rice-related Chinese questions are newly added every day. The rapid detection of the same semantic question is the key to the success of a rice-related intelligent Q&A system. To allow the fast and automatic detection of the same semantic rice-related questions, we propose a new method based on the Coattention-DenseGRU (Gated Recurrent Unit). According to the rice-related question characteristics, we applied word2vec with the TF-IDF (Term Frequency–Inverse Document Frequency) method to process and analyze the text data and compare it with the Word2vec, GloVe, and TF-IDF methods. Combined with the agricultural word segmentation dictionary, we applied Word2vec with the TF-IDF method, effectively solving the problem of high dimension and sparse data in the rice-related text. Each network layer employed the connection information of features and all previous recursive layers’ hidden features. To alleviate the problem of feature vector size increasing due to dense splicing, an autoencoder was used after dense concatenation. The experimental results show that rice-related question similarity matching based on Coattention-DenseGRU can improve the utilization of text features, reduce the loss of features, and achieve fast and accurate similarity matching of the rice-related question dataset. The precision and F1 values of the proposed model were 96.3% and 96.9%, respectively. Compared with seven other kinds of question similarity matching models, we present a new state-of-the-art method with our rice-related question dataset. |
topic |
rice-related question similarity matching natural language processing densely connected GRU coattention mechanism question-and-answering communities |
url |
https://www.mdpi.com/2073-4395/11/7/1307 |
work_keys_str_mv |
AT haoriqinwang adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT huajizhu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT huaruiwu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT xiaominwang adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT xiaohan adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT tongyuxu adenselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT haoriqinwang denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT huajizhu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT huaruiwu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT xiaominwang denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT xiaohan denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching AT tongyuxu denselyconnectedgruneuralnetworkbasedoncoattentionmechanismforchinesericerelatedquestionsimilaritymatching |
_version_ |
1721289934860451840 |