Transfer across tasks

Mixture of experts

Sparse models: more parameters without a proportional compute increase.