Gemini 2.5 Pro: aIME benchmark labeling now specifies the 2025 competition
OnAirToday’s tracker says the benchmark label now identifies the 2025 competition.
AIME benchmark labeling now specifies the 2025 competition — verified by the OnAirToday AI Progress Tracker against Google DeepMind's published documentation.
OnAirToday
Newsroom
The OnAirToday AI Progress Tracker recorded a verified change to Google DeepMind's Gemini 2.5 Pro (version gemini-2.5-pro): AIME benchmark labeling now specifies the 2025 competition.
Gemini 2.5 Pro is Google's reasoning-focused multimodal model, accepting text, images, audio and video and generating text. Its documented configuration combines a million-token input window with coding, scientific reasoning and tool-use capabilities, although generated answers and actions still require validation.
What changed in this review:
- Capability score 64 → 72
- Flaws and limitations updated
- Risks and threats updated
Teams building on Gemini 2.5 Pro should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.
The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gemini-2-5-pro.
References:
- https://arxiv.org/abs/2507.06261
- https://ai.google.dev/gemini-api/docs/models
- https://ai.google.dev/gemini-api/docs/pricing
- https://ai.google.dev/gemini-api/docs/changelog
Generated insight by OnAirToday AI
Specifying the 2025 competition makes the benchmark label more precise and helps readers identify which AIME reference is being used. The verification against Google DeepMind’s documentation gives the reported change a clear source.
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.