AA LCR: Artificial Analysis Long Context Reasoning

How It Works

Most long-context benchmarks only test whether a model can retrieve a specific fact from a long input ("needle in a haystack"). AA LCR goes further: it tests reasoning that requires synthesizing information spread across the entire long context. Scores at the longest tiers separate models that genuinely use their context window from models that only claim to.

Models receive a long input plus a question that requires reasoning across multiple sections. Scores are reported per length tier so users can see where each model breaks down.