AI Research

    GPT-OSS-20B: gPQA Diamond now reports OpenAI’s published launch result of 71.5%; evaluation settings may differ from other published results

    Tracker adopts OpenAI’s 71.5% launch score and flags possible evaluation-setting differences

    GPQA Diamond now reports OpenAI’s published launch result of 71.5%; evaluation settings may differ from other published results — verified by the OnAirToday AI Progress Tracker against OpenAI's published documentation.

    O

    OnAirToday

    Newsroom

    OnAirToday

    The OnAirToday AI Progress Tracker recorded a verified change to OpenAI's GPT-OSS-20B (version gpt-oss-20b): GPQA Diamond now reports OpenAI’s published launch result of 71.5%; evaluation settings may differ from other published results.

    GPT-OSS-20B is OpenAI’s Apache 2.0–licensed, open-weight reasoning model, supporting text generation, tool use and adjustable reasoning effort. Its mixture-of-experts architecture supports local deployment, with the released quantization designed to fit within approximately 16 GB of memory.

    What changed in this review:

    • Added OpenAI’s published SWE-bench Verified launch result of 60.7%.
    • Removed the unverified OTIS Mock AIME and Terminal-Bench entries.
    • Cleared token prices: the open-weight release has no single provider-independent input or output rate.

    Teams building on GPT-OSS-20B should confirm limits, pricing and benchmark coverage against the vendor's own documentation before relying on these figures.

    The full profile — capabilities, benchmark citations, known flaws and risk guidance — is on the tracker at /ai-models/gpt-oss-20b.

    References:

    • https://openai.com/index/introducing-gpt-oss/
    • https://huggingface.co/openai/gpt-oss-20b
    • https://github.com/openai/gpt-oss
    AI Analysis

    Generated insight by OnAirToday AI

    The update aligns the tracker with OpenAI’s published launch figure for GPT-OSS-20B on GPQA Diamond. The note that evaluation settings may differ is important because scores from different setups may not be directly comparable.

    Powered by AI • Not a substitute for human analysisMore Insights →
    Read the full story at OnAirToday →
    Share
    Filed under:AI Research

    Comments

    Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.

    0/1000