Review of Pre-training Techniques for Natural Language Processing
In the published reviews of natural language pre-training technology, most literatures only elaborate neural network pre-training technologies or a brief introduction to traditional pre-training technologies, which may result in the development process of natural language pre-training dissected arti...
Main Author: | CHEN Deguang, MA Jinlin, MA Ziping, ZHOU Jie |
---|---|
Format: | Article |
Language: | zho |
Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2021-08-01
|
Series: | Jisuanji kexue yu tansuo |
Subjects: | |
Online Access: | http://fcst.ceaj.org/CN/abstract/abstract2823.shtml |
Similar Items
-
Training Pre-Service Language Teachers
by: Janez Skela
Published: (2004-12-01) -
Leveraging Pre-Trained Language Model for Summary Generation on Short Text
by: Shuai Zhao, et al.
Published: (2020-01-01) -
Investigating the impact of pre-processing techniques and pre-trained word embeddings in detecting Arabic health information on social media
by: Yahya Albalawi, et al.
Published: (2021-07-01) -
Foundation Models for Natural Language Processing Pre-trained Language Models Integrating Media
Published: (2023) -
MEM-KGC: Masked Entity Model for Knowledge Graph Completion With Pre-Trained Language Model
by: Bonggeun Choi, et al.
Published: (2021-01-01)