GPT-5.1: added the launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement
Quantifying model performance through verified historical software engineering benchmarks.
Added the launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement — verified by the OnAirToday AI Progress Tracker against OpenAI's published documentation.
OnAirToday
Newsroom
The OnAirToday AI Progress Tracker recorded a verified change to OpenAI's GPT-5.1 (version gpt-5.1): Added the launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement.
GPT-5.1 is an OpenAI model for text generation, coding and tool-driven workflows, with image input and configurable reasoning effort. This profile reflects published launch specifications, not a live-verified September 2026 availability or pricing check; the supplied later-family headlines alone do not establish changes to GPT-5.1.
Teams building on GPT-5.1 should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.
The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gpt-5-1.
References:
- https://openai.com/index/gpt-5-1/
- https://openai.com/index/gpt-5-1-for-developers/
- https://platform.openai.com/docs/models/gpt-5.1
Generated insight by OnAirToday AI
Integrating established SWE-bench Verified results provides a more transparent benchmark for evaluating LLM software engineering capabilities. This historical validation helps stakeholders distinguish between marketing claims and documented performance in complex coding environments.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.