Long-Context Models
Artificial Intelligence
How LLMs Handle Infinite Context With Finite Memory
1. Introduction
two years, we witnessed a race for sequence length in AI language models. We regularly evolved from 4k context length to 32k, then 128k, to the huge 1-million token window first promised...
Recent posts
