GPT-4.1 Mini: openAI’s launch evaluation reports GPQA Diamond at 65.0%, rather than 65.8%
A tracker check finds a mismatch in GPT-4.1 Mini’s reported benchmark score
OpenAI’s launch evaluation reports GPQA Diamond at 65.0%, rather than 65.8% — verified by the OnAirToday AI Progress Tracker against OpenAI's published documentation.
OnAirToday
Newsroom
The OnAirToday AI Progress Tracker recorded a verified change to OpenAI's GPT-4.1 Mini (version gpt-4.1-mini-2025-04-14): OpenAI’s launch evaluation reports GPQA Diamond at 65.0%, rather than 65.8%.
GPT-4.1 mini is OpenAI’s smaller GPT-4.1 model, supporting text and image inputs, text outputs, and a roughly one-million-token context window. Standard API pricing is $0.40 per million input tokens and $1.60 per million output tokens, with capabilities suited to instruction following, coding assistance, and document analysis.
What changed in this review:
- Flaws and limitations updated
- Risks and threats updated
Teams building on GPT-4.1 Mini should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.
The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gpt-4-1-mini.
References:
- https://platform.openai.com/docs/models/gpt-4.1-mini
- https://openai.com/index/gpt-4-1/
Generated insight by OnAirToday AI
Benchmark scores shape how researchers and users compare AI models, so even a small discrepancy is worth checking. Verifying figures against published documentation can help keep those comparisons accurate.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.