| GLM-5.3-Flash | Z.ai | GLM-5.3-Flash | Not stated in retained source | Z.ai API; self-hostable via vLLM/SGLang/Transformers | Open-weight and model materials under MIT | MIT | 320B total / 18B active | Not published in retained source | Not published in retained source | Text and image input; text output; low/high/max thinking effort | Not published in retained source | Not published in retained source | Not published in retained source | Not published in retained source | View 3 results for GLM-5.3-Flash- Terminal-Bench 2.1: 84.3%
Model-card reported Setting: Claude Code 2.1.207; temperature 1; top_p 1; max generation 65,536; 6-hour limit - DeepSWE v1.1: 63.4%
Model-card reported Setting: mini-swe-agent; temperature .95; top_p 1; 400K context (not output); 6-hour limit - Humanity's Last Exam (with tools): 55.3%
Model-card reported Setting: Full set; temperature 1; top_p .95; max generation 163,840; 300K evaluation context; GPT-5.6 Luna medium judge
Record source IDs: glm53-card | Evidence |
| Qwen3.8 2.4T A95B | Qwen | Qwen3.8-2.4T-A95B | Not stated in retained source | Self-hostable weights; hosted Qwen3.8-Max is a distinct serving variant | Open-weight; license is not OSI-identified in retained source | Qwen3.8 Max custom license | 2.4T total / 95B active | 262,144 native / 1,010,000 extensible tokens | Not published in retained source | Text input and output. Hosted Qwen3.8-Max adds capabilities not assigned to these weights. | Not published in retained source | Not published in retained source | Not published in retained source | Not published in retained source | Not published in retained source | Evidence |
| Kimi K3 | Moonshot AI | kimi-k3 | Not stated in retained source | Kimi API (OpenAI/Anthropic compatible); self-hostable weights | Open-weight; custom license | Kimi K3 custom license; commercial conditions apply | 2.8T total / 104B active | 1,048,576-token context window | max_completion_tokens up to 1,048,576; default 131,072; subject to shared context budget | Text, image and video input; text output; always-on thinking; tool calls; strict JSON Schema. Custom license: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE | $3 / 1M uncached tokens; cache writes billed separately | $15 / 1M tokens | Not published in retained source | Not published in retained source | View 3 results for Kimi K3- GPQA Diamond: 93.5%
Model-card reported Setting: Max reasoning; temperature 1; top_p .95; single-step evaluation - Terminal-Bench 2.1: 88.3%
Model-card reported Setting: Max reasoning; temperature 1; top_p 1; Kimi Code harness - DeepSWE v1.1: 67.5%
Model-card reported Setting: Max reasoning; temperature 1; top_p 1; Kimi Code harness (not mini-SWE-agent)
Record source IDs: kimi-card, kimi-guide, kimi-pricing | Evidence |
| Gemini 3.8 Flash | Google | gemini-3.8-flash | Not stated in retained source | Gemini API | Proprietary API model | Google API terms | Not published in retained source | 1,048,576-token input limit | 65,536 tokens | Text, image, audio, video and PDF input; text output; function calling; structured output | $0.75 / 1M uncached tokens (Introductory, through 2026-12-31); $1.5 / 1M uncached tokens (Announced standard, from 2027-01-01) | $3.75 / 1M tokens (Introductory, through 2026-12-31); $7.5 / 1M tokens (Announced standard, from 2027-01-01) | Not published in retained source | Not published in retained source | Not published in retained source | Evidence |
| GPT-6 Sol | OpenAI | gpt-6-sol | 2026-09-22 | OpenAI API (Responses, Chat Completions, Batch); Amazon Bedrock (Runtime and Mantle; Mantle us-east-1) | Proprietary API model | Provider terms | Not published in retained source | 1,050,000-token context window; maximum input 922,000 tokens | 128,000 tokens | Text and image input; text output; streaming; structured outputs; Responses tools and function calling. Reasoning: none, low, medium (default), high, xhigh, max. Chat Completions function calling requires reasoning_effort none. No native audio/video or fine-tuning. | $2 / 1M uncached tokens (Standard, prompts up to 272K input) | $10 / 1M tokens (Standard, prompts up to 272K input) | Not published in retained source | Not published in retained source | View 4 results for GPT-6 Sol- ExploitBench (Cap Percent): 81.7%
Provider reported Setting: OpenAI system card section 11.8.1.2.1, Figure 79; maximum reasoning effort. Capability-flag credit across five attempts on 41 vulnerabilities, not simple pass@1. Historical-vulnerability contamination warning applies. - ExploitBench - Internal Port (June-August 2026): 5.5%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 80; maximum reported success rate on recent vulnerabilities. Exact effort associated with this maximum not verified from figure. - SEC-Bench Pro: 66.3%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 81; vulnerability discovery in JavaScript engines. Exact effort and output-token budget for this point not verified. - ExploitGym: 22.1%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 82; challenges with successful exploit development. Exact effort and token budget not verified; not a general coding accuracy measure.
Record source IDs: openai-sol-docs-0923, openai-api-changelog-0922, openai-pricing-0923, openai-sol-luna-system-card | Evidence |
| GPT-6 Luna | OpenAI | gpt-6-luna | 2026-09-22 | OpenAI API (Responses, Chat Completions, Batch); Amazon Bedrock (Runtime and Mantle; Mantle us-east-1) | Proprietary API model | Provider terms | Not published in retained source | 1,050,000-token context window; maximum input 922,000 tokens | 128,000 tokens | Text and image input; text output; streaming; structured outputs; Responses tools and function calling. Reasoning: none, low, medium (default), high, xhigh, max. Chat Completions function calling requires reasoning_effort none. No native audio/video or fine-tuning. | $0.10 / 1M uncached tokens (Standard, prompts up to 272K input) | $0.50 / 1M tokens (Standard, prompts up to 272K input) | Not published in retained source | Not published in retained source | View 4 results for GPT-6 Luna- ExploitBench (Cap Percent): 43.4%
Provider reported Setting: OpenAI system card section 11.8.1.2.1, Figure 79; maximum reasoning effort. Capability-flag credit across five attempts on 41 vulnerabilities, not simple pass@1. Historical-vulnerability contamination warning applies. - ExploitBench - Internal Port (June-August 2026): 0%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 80; source explicitly reports no completed challenges. This is an observed zero, not missing evidence. Exact effort not verified. - SEC-Bench Pro: 34.2%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 81; vulnerability discovery in JavaScript engines. Exact effort and output-token budget for this point not verified. - ExploitGym: 11.6%
Provider reported Setting: OpenAI system card section 11.8.1.2.2, Figure 82; challenges with successful exploit development. Exact effort and token budget not verified; not a general coding accuracy measure.
Record source IDs: openai-luna-docs-0923, openai-api-changelog-0922, openai-pricing-0923, openai-sol-luna-system-card | Evidence |
| Claude Opus 5.5 | Anthropic | claude-opus-5-5 | 2026-09-22 | Claude API; Amazon Bedrock; Google Cloud; Microsoft Foundry; Claude Platform on AWS | Proprietary API model | Provider terms; specific contractual reuse rights not reviewed | Not published in retained source | 1M-token context window | 128K tokens; Message Batches API beta supports up to 300K with output-300k-2026-03-24 | Text and image input; text output; always-on adaptive thinking, default medium effort; tools and structured outputs. Thinking cannot be disabled; forced tool_choice any/tool is unsupported. | $4 / 1M uncached tokens (standard Claude API) | $20 / 1M tokens (standard Claude API) | Not published in retained source | Not published in retained source | View 2 results for Claude Opus 5.5- Terminal-Bench 4.0: 66.4%
Provider reported Setting: Anthropic; Claude Code --bare; adaptive xhigh; 5 trials/task; safeguards and fallback enabled. Detailed card: 66.36%, standard error 2.6 points. - Humanity's Last Exam (no tools): 64.4%
Provider reported Setting: Anthropic; max effort; no tools; 1M total-token cap; no compaction; Opus 4.6 grader.
Record source IDs: anthropic-opus55-spec, anthropic-opus55-launch, anthropic-opus55-card, anthropic-pricing, anthropic-platform-release-notes | Evidence |
| DeepSeek V4.1-Flash | DeepSeek | deepseek-flash | 2026-09-10 | DeepSeek API (`deepseek-flash`); provider links weights | Open-weight status indicated by provider; license not verified in retained source | Not published in retained source | 552B total / 8B input-active / 16B output-active | 1M-token context window | 384K tokens | Text and image input; text output; thinking and non-thinking; JSON output; tool calls | $0.3 / 1M uncached tokens (Peak hours, conservative scenario); $0.15 / 1M uncached tokens (Off-peak hours) | $1.2 / 1M tokens (Peak hours, conservative scenario); $0.6 / 1M tokens (Off-peak hours) | Not published in retained source | Not published in retained source | Not published in retained source | Evidence |
| GPT-6 Astra | OpenAI | gpt-6-astra | 2026-09-03 | OpenAI API; Azure; Amazon Bedrock | Proprietary API model | Provider terms | Not published in retained source | 1,050,000-token context window (not an input-only limit) | 128,000 tokens | Text and image input; text output; function calling; structured output | $10 / 1M uncached tokens (Standard, prompts up to 272K input) | $50 / 1M tokens (Standard, prompts up to 272K input) | Not published in retained source | Not published in retained source | View 2 results for GPT-6 Astra- Terminal-Bench 4.0: 57.9%
Provider reported Setting: OpenAI evaluation; provider setting retained in launch report - GPQA Diamond: 96.0%
Provider reported Setting: OpenAI evaluation; provider setting retained in launch report
Record source IDs: openai-api, openai-gpt6-launch | Evidence |
| Claude Fable 5.1 | Anthropic | claude-fable-5-1 | 2026-09-01 | Claude API; Amazon Web Services; Google Cloud; Microsoft Azure | Proprietary API model | Provider terms | Not published in retained source | 1M-token context window | 128K tokens | Text and image input; text output; adaptive thinking | $10 / 1M uncached tokens (Standard Claude API) | $50 / 1M tokens (Standard Claude API) | Not published in retained source | Not published in retained source | View 7 results for Claude Fable 5.1- Terminal-Bench-Science 0.1: 52.6%
Provider reported Setting: Production safeguards enabled; Anthropic setup - Terminal-Bench 4.0: 55.8%
Provider reported Setting: Production safeguards enabled; Anthropic setup - Humanity's Last Exam (no tools): 60.9%
Provider reported Setting: Production safeguards enabled; no tools - Humanity's Last Exam (with tools): 65.0%
Provider reported Setting: Production safeguards enabled; with tools - CursorBench 3.2.0: 73.4%
Provider reported Setting: Max effort; Anthropic report - OSWorld 2.0 (partial): 77.9%
Provider reported Setting: August 2026 task release; partial completion; production safeguards enabled - OSWorld 2.0 (strict): 41.7%
Provider reported Setting: August 2026 task release; strict completion; production safeguards enabled
Record source IDs: anthropic-fable51, claude-fable-spec | Evidence |
| Mistral Large 3 | Mistral AI | mistral-large-2512 | 2025-12-02 | Mistral API; Amazon Bedrock; Microsoft Azure | Open-weight | Apache 2.0 | 675B total / 41B active | 256K-token context window | Not published in retained source | Text and image input; text output; function calling; structured output | $0.5 / 1M uncached tokens (Standard Mistral API) | $1.5 / 1M tokens (Standard Mistral API) | Not published in retained source | Not published in retained source | Not published in retained source | Evidence |