Papers & Research
RePo
Sakana AI's RePo lets LLMs dynamically reorganize their context
Sakana AI introduced RePo, a research technique that lets language models dynamically reorganize their context for better attention. The paper proposes a new way to manage what a model focuses on, aimed at improving performance on long-context tasks.