benchmarks
Claude Opus 4.1 is Anthropic’s August 2025 model for coding, agentic workflows, research and analysis, with a documented 200K-token context window. Its published SWE-bench Verified result is 74.5%, and newer Opus generations, including Opus 4.5, have subsequently shipped.
Benchmark results
Every figure links to where it was published. Compare like with like — harnesses and prompt setups differ between vendors.
| Benchmark | Score | Source |
|---|---|---|
| SWE-bench VerifiedResolving real GitHub issues | 74.5%5 Aug 2025 | View |
| GPQA DiamondPhD-level science questions | 77.3%5 Aug 2025 | View |
| OTIS Mock AIME 2024-25Competition mathematics | 68.9%5 Aug 2025 | View |
| Terminal-BenchLong-horizon command-line agent tasks | 38%31 Oct 2025 | View |
| FrontierMath | 7.2%5 Aug 2025 | View |
| LMArena TextHuman preference Elo from blind chat votes (not a percentage) | 1419 Elo22 Oct 2026 | View |
| LMArena WebDevHuman preference Elo for building web apps (not a percentage) | 1391 Elo23 Oct 2026 | View |
Weighted mean of 5 verified benchmark results: SWE-bench Verified 74.5%, GPQA Diamond 77.3%, OTIS Mock AIME 2024-25 68.9%, Terminal-Bench 38%, FrontierMath 7.2%.
Capabilities
- Software engineering, including repository-level debugging and multi-file code changes.
- Agentic workflows involving tools and multiple execution steps.
- Research and data analysis with improved detail tracking.
- Extended thinking for complex reasoning tasks.
- Text and image input with text output.
What improved
- Anthropic’s SWE-bench Verified result increased from 72.5% for Opus 4 to 74.5% for Opus 4.1.
- GitHub reported stronger multi-file code refactoring than Opus 4.
- Rakuten reported more precise debugging corrections with fewer unnecessary changes.
- Anthropic reported improvements in research, data analysis, detail tracking and agentic search.
Known flaws & limitations
- The documented context window is 200K tokens.
- The documented maximum output is 32K tokens.
- Native audio and video input are not supported.
- The published SWE-bench Verified result does not establish reliable completion of every software-engineering task.
Risks, safety & security issues
- Coding and tool-use capabilities can be abused to support data theft and extortion, as documented in Anthropic’s reporting on Claude Code misuse.
- Broad access to sensitive files and external tools can increase the impact of malicious or unauthorized workflows.
- Automated analysis of stolen information and generation of personalized extortion demands can increase the scale of criminal operations.
Good fit for
- Complex codebase debugging and multi-file refactoring with human review.
- Research and document analysis within the documented context limit.
- Tool-assisted workflows with narrowly scoped permissions and approval gates.
- Detailed analytical tasks that benefit from extended thinking.
Poor fit for
- Applications requiring native audio or video understanding.
- Tasks requiring more than 200K tokens in one context or more than 32K output tokens.
- Unsupervised operations involving sensitive data, production systems or irreversible actions.
References
Profile last reviewed 10/27/2026 and re-checked automatically every few hours against the vendor's published documentation, papers and public leaderboards. Scores come from the cited benchmark results above — confirm limits and pricing against the provider's own documentation before building on them.