AI Progress Tracker
77from 7
benchmarks
benchmarks
This profile concerns Gemini 3.5 Flash from Google DeepMind. Not yet confirmed by public reporting.
context: 1Mtextimagevideofileaudio$1.50 / $9.00 per 1M tokens (in / out)
Benchmark results
Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.
| Benchmark | Score | Source |
|---|---|---|
| GPQA DiamondPhD-level science questions | 92.8%22 May 2026 | View |
| SWE-bench VerifiedResolving real GitHub issues | 79.3%1 Jun 2026 | View |
| OTIS Mock AIME 2024-25Competition mathematics | 95.6%25 May 2026 | View |
| FrontierMath | 39%22 May 2026 | View |
| SimpleQA VerifiedShort factual questions (hallucination resistance) | 66.2%27 Aug 2026 | View |
| LMArena TextHuman preference Elo from blind chat votes (not a percentage) | 1482 Elo22 Oct 2026 | View |
| LMArena WebDevHuman preference Elo for building web apps (not a percentage) | 1499 Elo23 Oct 2026 | View |
Weighted mean of 5 verified benchmark results: GPQA Diamond 92.8%, SWE-bench Verified 79.3%, OTIS Mock AIME 2024-25 95.6%, FrontierMath 39%, SimpleQA Verified 66.2%.
Capabilities
- Not yet confirmed by public reporting.
What improved
- Not yet confirmed by public reporting.
Known flaws & limitations
- Not yet confirmed by public reporting.
Risks, safety & security issues
- Not yet confirmed by public reporting.
Good fit for
- Not yet confirmed by public reporting.
Poor fit for
- Not yet confirmed by public reporting.
Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.