AI Progress Tracker
81from 4
benchmarks
benchmarks
Not yet confirmed by public reporting. A reported malicious npm campaign concerns third-party AI tooling, not a demonstrated vulnerability in Gemini 3.1 Flash Lite.
context: 1Mtextimagevideofileaudio$0.25 / $1.50 per 1M tokens (in / out)
Benchmark results
Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.
| Benchmark | Score | Source |
|---|---|---|
| GPQA DiamondPhD-level science questions | 81.8%6 Aug 2026 | View |
| OTIS Mock AIME 2024-25Competition mathematics | 80%6 Aug 2026 | View |
| LMArena TextHuman preference Elo from blind chat votes (not a percentage) | 1416 Elo22 Oct 2026 | View |
| LMArena WebDevHuman preference Elo for building web apps (not a percentage) | 1256 Elo23 Oct 2026 | View |
Weighted mean of 2 verified benchmark results: GPQA Diamond 81.8%, OTIS Mock AIME 2024-25 80%.
Capabilities
- Not yet confirmed by public reporting.
What improved
- Not yet confirmed by public reporting.
Known flaws & limitations
- Not yet confirmed by public reporting.
Risks, safety & security issues
- Malicious npm packages promoted through free AI-credit offers can expose developers to information stealers and backdoors.
- Compromised third-party agent tooling can hijack AI traffic without exploiting a vulnerability in the underlying model.
Good fit for
- Not yet confirmed by public reporting.
Poor fit for
- Not yet confirmed by public reporting.
References
Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.