benchmarks
GLM 5.1 belongs to Z.ai (Zhipu AI)'s GLM model family. Family-level security reporting concerns GLM 5.2's defensive use during an attack on Hugging Face, rather than an established vulnerability in GLM 5.1.
Benchmark results
Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.
| Benchmark | Score | Source |
|---|---|---|
| GPQA DiamondPhD-level science questions | 89.9%10 Aug 2026 | View |
| SWE-bench VerifiedResolving real GitHub issues | 74.2%15 May 2026 | View |
| OTIS Mock AIME 2024-25Competition mathematics | 93.3%10 Aug 2026 | View |
| FrontierMath | 33.4%11 May 2026 | View |
| SimpleQA VerifiedShort factual questions (hallucination resistance) | 34%27 Aug 2026 | View |
| LMArena TextHuman preference Elo from blind chat votes (not a percentage) | 1463 Elo22 Oct 2026 | View |
| LMArena WebDevHuman preference Elo for building web apps (not a percentage) | 1508 Elo23 Oct 2026 | View |
Weighted mean of 5 verified benchmark results: GPQA Diamond 89.9%, SWE-bench Verified 74.2%, OTIS Mock AIME 2024-25 93.3%, FrontierMath 33.4%, SimpleQA Verified 34%.
Capabilities
- Not yet confirmed by public reporting.
What improved
- Not yet confirmed by public reporting.
Known flaws & limitations
- Not yet confirmed by public reporting.
Risks, safety & security issues
- Not yet confirmed by public reporting.
Good fit for
- Not yet confirmed by public reporting.
Poor fit for
- Not yet confirmed by public reporting.
References
Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.