GPT-5.1: added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement
Quantifying the performance legacy of GPT-5.1 through validated SWE-bench benchmarks.
Added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement — verified by the OnAirToday AI Progress Tracker against OpenAI's published documentation.
OnAirToday
Newsroom
The OnAirToday AI Progress Tracker recorded a verified change to OpenAI's GPT-5.1 (version gpt-5.1): Added launch-reported SWE-bench Verified result; this is historical evidence, not a newly measured improvement.
GPT-5.1 is OpenAI's general-purpose reasoning model with text and image input, text output, configurable reasoning effort, and tool-calling support. This profile reflects launch-era documentation; without live source access, I cannot independently verify its September 2026 availability, pricing, or successor releases.
What changed in this review:
- Current availability, pricing, and successor releases remain unverified; prices are USD per million tokens for standard API input and output.
Teams building on GPT-5.1 should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.
The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gpt-5-1.
References:
- https://openai.com/index/gpt-5-1/
- https://openai.com/index/gpt-5-1-for-developers/
- https://platform.openai.com/docs/models/gpt-5.1
Generated insight by OnAirToday AI
The inclusion of historical SWE-bench Verified results for GPT-5.1 serves as a vital benchmark for evaluating the long-term evolution of autonomous coding capabilities. This documentation establishes a clearer trajectory for agentic performance, allowing researchers to distinguish between retroactive validation and genuine leaps in problem-solving efficacy.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.