AI Progress Tracker

    GLM 5.1 · GLM 5.1

    Z.ai · 7 Apr 2026

    Ask the Advisor about this model
    68from 7
    benchmarks

    GLM 5.1 belongs to Z.ai (Zhipu AI)'s GLM model family. Family-level security reporting concerns GLM 5.2's defensive use during an attack on Hugging Face, rather than an established vulnerability in GLM 5.1.

    context: 205Ktext$0.97 / $3.04 per 1M tokens (in / out)

    Benchmark results

    Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.

    BenchmarkScoreSource
    GPQA DiamondPhD-level science questions89.9%10 Aug 2026View
    SWE-bench VerifiedResolving real GitHub issues74.2%15 May 2026View
    OTIS Mock AIME 2024-25Competition mathematics93.3%10 Aug 2026View
    FrontierMath33.4%11 May 2026View
    SimpleQA VerifiedShort factual questions (hallucination resistance)34%27 Aug 2026View
    LMArena TextHuman preference Elo from blind chat votes (not a percentage)1463 Elo22 Oct 2026View
    LMArena WebDevHuman preference Elo for building web apps (not a percentage)1508 Elo23 Oct 2026View

    Weighted mean of 5 verified benchmark results: GPQA Diamond 89.9%, SWE-bench Verified 74.2%, OTIS Mock AIME 2024-25 93.3%, FrontierMath 33.4%, SimpleQA Verified 34%.

    Capabilities

    • Not yet confirmed by public reporting.

    What improved

    • Not yet confirmed by public reporting.

    Known flaws & limitations

    • Not yet confirmed by public reporting.

    Risks, safety & security issues

    • Not yet confirmed by public reporting.

    Good fit for

    • Not yet confirmed by public reporting.

    Poor fit for

    • Not yet confirmed by public reporting.

    Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.