Event · now
Memory and context
Lost in the middle
Long context fits, but attention to its middle sags: the model recalls the start and the end better than what lies between.
Memory and context
Long context fits, but attention to its middle sags: the model recalls the start and the end better than what lies between.