Event · now
Transfer across tasks
Fighting the quadratic cost
Attention costs grow as the square of the input length. Linear and hybrid schemes are the main engineering work here.
Transfer across tasks
Attention costs grow as the square of the input length. Linear and hybrid schemes are the main engineering work here.