GPT-5.1: added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement
Quantifying model performance through verified historical benchmarks
Added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement — verified by the OnAirToday AI Progress Tracker against OpenAI's published documentation.
OnAirToday
Newsroom
The OnAirToday AI Progress Tracker recorded a verified change to OpenAI's GPT-5.1 (version gpt-5.1): Added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement.
GPT-5.1 is an OpenAI model documented for text and image inputs, text output, coding, and tool-assisted workflows with configurable reasoning effort. This profile reflects launch documentation and the supplied snapshot; live availability, current pricing, and successor releases could not be independently rechecked here.
Teams building on GPT-5.1 should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.
The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gpt-5-1.
References:
- https://platform.openai.com/docs/models/gpt-5.1
- https://openai.com/index/gpt-5-1-for-developers/
- https://openai.com/index/gpt-5-1/
Generated insight by OnAirToday AI
The inclusion of historical SWE-bench data provides a standardized metric for evaluating the real-world coding capabilities of frontier AI models. This transparency helps distinguish between genuine architectural advancements and mere performance reporting updates in an increasingly crowded ecosystem.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.