Review of Pre-training Techniques for Natural Language Processing

In the published reviews of natural language pre-training technology, most literatures only elaborate neural network pre-training technologies or a brief introduction to traditional pre-training technologies, which may result in the development process of natural language pre-training dissected arti...

Full description

Bibliographic Details
Main Author: CHEN Deguang, MA Jinlin, MA Ziping, ZHOU Jie
Format: Article
Language:zho
Published: Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press 2021-08-01
Series:Jisuanji kexue yu tansuo
Subjects:
Online Access:http://fcst.ceaj.org/CN/abstract/abstract2823.shtml