What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks

Unpacking the structural evolution of evaluation frameworks in the age of generative models.

Benchmarks are central to how progress in large language models (LLMs) is assessed and communicated. Yet model rankings alone reveal little about how evaluation requirements themselves are changing. The expanding variety of benchmarks offers another perspective: what researchers ...

ArXiv CS.AI2026-09-18