BAIDU’s ERNIE 2.0

ERNIE 2.0 is a continual pre-training framework. Continual learning aims to train the model with several tasks in sequence so that it remembers the previously learned tasks when learning the new ones.

For more details, visit the source.