Transfer across tasks

GPT

Pretraining a transformer on a large corpus and then adapting it to a task became a repeatable transfer-learning recipe.