Language modeling and bidirectional coders representations: an overview of key technologies

The article is an essay on the development of technologies for natural language processing, which formed the basis of BERT (Bidirectional Encoder Representations from Transformers), a language model from Google, showing high results on the whole class of problems associated with the understanding of...

Full description

Bibliographic Details
Main Author: D. I. Kachkou
Format: Article
Language:Russian
Published: The United Institute of Informatics Problems of the National Academy of Sciences of Belarus 2021-01-01
Series:Informatika
Subjects:
Online Access:https://inf.grid.by/jour/article/view/1080