Event · 2017-06
Transfer across tasks
Attention Is All You Need
The Transformer replaced recurrence with attention and scaled better on parallel compute.
Sources
arXivOpen primary source Transfer across tasks
The Transformer replaced recurrence with attention and scaled better on parallel compute.