AI Progress Tracker
88from 5
benchmarks
benchmarks
Not yet confirmed by public reporting. The reported third-party npm malware campaign does not establish a vulnerability specific to Gemini 3.7 Flash.
context: 1Mtextimagevideofileaudio$0.75 / $3.75 per 1M tokens (in / out)
Benchmark results
Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.
| Benchmark | Score | Source |
|---|---|---|
| GPQA DiamondPhD-level science questions | 94.8%14 Aug 2026 | View |
| OTIS Mock AIME 2024-25Competition mathematics | 97.2%14 Aug 2026 | View |
| SimpleQA VerifiedShort factual questions (hallucination resistance) | 69.2%27 Aug 2026 | View |
| LMArena TextHuman preference Elo from blind chat votes (not a percentage) | 1490 Elo22 Oct 2026 | View |
| LMArena WebDevHuman preference Elo for building web apps (not a percentage) | 1590 Elo23 Oct 2026 | View |
Weighted mean of 3 verified benchmark results: GPQA Diamond 94.8%, OTIS Mock AIME 2024-25 97.2%, SimpleQA Verified 69.2%.
References
Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.