Lifelong Language Learning With the Most Forgotten Knowledge

Lifelong language learning enables a language model to accumulate knowledge through training on a stream of text data. Recent research on lifelong language learning is based on samples of previous tasks from an episodic memory or generative model. LAMOL, a representative generative model-based lifel...

Full description

Bibliographic Details
Main Authors: Heejeong Choi, Pilsung Kang
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9399079/