Sampling
integer
83 models
Top K
top_k
Limits token sampling to the top K most likely next tokens.
- Type
- integer
- Default
- varies by model
- Range
- 0 – 100
top_k by model
The exact type, default, range, and conditions for top_k on each model that documents it.
| Model | Provider | Type | Default | Range / values | Condition |
|---|---|---|---|---|---|
| Claude 3 Opus 20240229 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3 Opus Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet 20250219 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 20251001 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Haiku 4.5 20251001 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Opus 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Opus 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 20250929 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 20250929 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| DeepSeek v4 Flash 0731 | Fireworks | integer | — | 1…100 | — |
| DeepSeek v4 Flash Vision Exp | Fireworks | integer | — | 1…100 | — |
| DeepSeek v4 Pro | Fireworks | integer | — | 1…100 | — |
| DeepSeek v4 Pro 0813 | Fireworks | integer | — | 1…100 | — |
| DeepSeek V4p1 Flash | Fireworks | integer | — | 1…100 | — |
| Ember 1 | Fireworks | integer | — | 1…100 | — |
| GLM-5p2 | Fireworks | integer | — | 1…100 | — |
| GLM-5p3 | Fireworks | integer | — | 1…100 | — |
| GLM-5p3 Flash | Fireworks | integer | — | 1…100 | — |
| GPT-OSS 120B | Fireworks | integer | — | 1…100 | — |
| GPT-OSS 20B | Fireworks | integer | — | 1…100 | — |
| Inkling | Fireworks | integer | — | 1…100 | — |
| Kimi K2p6 | Fireworks | integer | — | 1…100 | — |
| Kimi K2p7 Code | Fireworks | integer | — | 1…100 | — |
| Kimi K3 | Fireworks | integer | — | 1…100 | — |
| MiniMax M2p7 | Fireworks | integer | — | 1…100 | — |
| MiniMax M3 | Fireworks | integer | — | 1…100 | — |
| Muse Glimmer 30B | Fireworks | integer | — | 1…100 | — |
| Nemotron 3 Ultra Nvfp4 | Fireworks | integer | — | 1…100 | — |
| Nemotron Lightning 3p5 30B A3B | Fireworks | integer | — | 1…100 | — |
| Qwen3p7 Plus | Fireworks | integer | — | 1…100 | — |
| Qwen3p8 2p4t A95B | Fireworks | integer | — | 1…100 | — |
| Qwen3p8 Max | Fireworks | integer | — | 1…100 | — |
| Gemma 3 12B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 1B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 27B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 4B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3n E2B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3n E4B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 12B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 E2B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 E4B IT | integer | 64 | 0…+∞ | — | |
| Llama 3.3 70B Instruct | Meta | integer | — | — | — |
| Llama 3.3 8B Instruct | Meta | integer | — | — | — |
| Llama 4 Maverick 17B 128E Instruct FP8 | Meta | integer | — | — | — |
| Llama 4 Scout 17B 16E Instruct FP8 | Meta | integer | — | — | — |
| DeepSeek Flash Subscription | Opencode Go | integer | — | 1…+∞ | — |
| DeepSeek v4 Flash Vision Exp Subscription | Opencode Go | integer | — | 1…+∞ | — |
| GLM-5.3 Subscription | Opencode Go | integer | — | 1…+∞ | — |
| GLM-5.3 Flash Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Hy3 Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Hy4 Preview Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Longcat 2.0 Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Longcat 2.5 Preview Free Subscription | Opencode Go | integer | — | 1…+∞ | — |
| MiMo v2.6 Flash Subscription | Opencode Go | integer | — | 1…+∞ | — |
| MiMo v2.6 Pro Subscription | Opencode Go | integer | — | 1…+∞ | — |
| MiniMax M2.7 Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Omen Alpha Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Qwen3.8 Flash Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Qwen3.8 Max Subscription | Opencode Go | integer | — | 1…+∞ | — |
| Space Bunny Free Subscription | Opencode Go | integer | — | 1…+∞ | — |
Models without top_k documented yet
top_k documented yet
These models don't list top_k in the catalog. That may mean the provider doesn't accept it, or it simply hasn't been added yet — the data is community-maintained.
Alibaba
DeepSeek v3.2
DeepSeek v4 Flash
DeepSeek v4 Flash 0731
DeepSeek v4 Pro
DeepSeek v4 Pro 0813
DeepSeek v4.1 Flash
GLM-5.1
GLM-5.2
GLM-5.3
GLM-5.3 Prime
Kimi K2.7 Code
Kimi K3
Qvq Max
Qwen Coder Plus
Qwen Flash
Qwen Flash Character
Qwen Max
Qwen Plus
Qwen Plus Character
Qwen Plus Latest
Qwen Turbo
Qwen Vl Max
Qwen Vl Plus
Qwen3 14B
Qwen3 235B A22B
Qwen3 235B A22B Instruct 2507
Qwen3 235B A22B Thinking 2507
Qwen3 30B A3B
Qwen3 30B A3B Instruct 2507
Qwen3 30B A3B Thinking 2507
Qwen3 8B
Qwen3 Coder 480B A35B Instruct
Qwen3 Coder Flash
Qwen3 Coder Next
Qwen3 Coder Plus
Qwen3 Max
Qwen3 Max Preview
Qwen3 Next 80B A3B Instruct
Qwen3 Next 80B A3B Thinking
Qwen3 Omni Flash
Qwen3 Omni Flash 2025-09-15
Qwen3 Omni Flash 2025-12-01
Qwen3 Vl 235B A22B Instruct
Qwen3 Vl 235B A22B Thinking
Qwen3 Vl Flash
Qwen3 Vl Flash 2026-01-22
Qwen3 Vl Plus
Qwen3 Vl Plus 2025-09-23
Qwen3 Vl Plus 2025-12-19
Qwen3.5
Qwen3.5 122B A10B
Qwen3.5 27B
Qwen3.5 35B A3B
Qwen3.5 397B A17B
Qwen3.5 Flash
Qwen3.5 Omni Flash
Qwen3.5 Omni Flash 2026-03-15
Qwen3.5 Omni Plus
Qwen3.5 Omni Plus 2026-03-15
Qwen3.5 Plus
Qwen3.5 Plus 2026-02-15
Qwen3.5 Plus 2026-04-20
Qwen3.6 27B
Qwen3.6 35B A3B
Qwen3.6 Flash
Qwen3.6 Max Preview
Qwen3.6 Plus
Qwen3.7 Flash
Qwen3.7 Max
Qwen3.7 Max Preview
Qwen3.7 Plus
Qwen3.8 2.4t A95B
Qwen3.8 27B
Qwen3.8 Flash
Qwen3.8 Max
Qwen3.8 Max 0902
Qwen3.8 Omni Flash
QwQ Plus
Anthropic
Bedrock
Claude Haiku 4.5
Claude Opus 4.5 20251101
Claude Opus 4.6
Claude Sonnet 4.5
Claude Sonnet 4.6
DeepSeek R1
DeepSeek v3.2
Devstral 2 123B
Gemma 3 12B IT
Gemma 3 27B IT
Gemma 3 4B IT
GLM-4.7
GLM-4.7 Flash
GLM-5
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
Kimi K2 Thinking
Kimi K2.5
Llama3 1 70B Instruct
Llama3 1 8B Instruct
Llama3 3 70B Instruct
Llama3 70B Instruct
Llama3 8B Instruct
Magistral Small 2509
MiniMax M2
MiniMax M2.1
MiniMax M2.5
Ministral 3 14B Instruct
Ministral 3 3B Instruct
Ministral 3 8B Instruct
Mistral 7B Instruct
Mistral Large 2402
Mistral Large 3 675B Instruct
Mistral Small 2402
Mixtral 8x7b Instruct
Nemotron Nano 12B
Nemotron Nano 3 30B
Nemotron Nano 9B
Nemotron Super 3 120B
Nova 2 Lite
Nova Lite
Nova Micro
Nova Pro
Palmyra Vision 7B
Palmyra X4
Palmyra X5
Pixtral Large 2502
Qwen3 32B
Qwen3 Coder 30B A3B
Qwen3 Coder Next
Qwen3 Next 80B A3B
Qwen3 Vl 235B A22B
Voxtral Mini 3B 2507
Voxtral Small 24B 2507
Cerebras
Cohere
Gemini 2.5 Flash
Gemini 2.5 Flash
Gemini 2.5 Flash Lite
Gemini 2.5 Flash Lite
Gemini 2.5 Pro
Gemini 2.5 Pro
Gemini 3 Flash Preview
Gemini 3 Flash Preview
Gemini 3.1 Flash Lite
Gemini 3.1 Flash Lite
Gemini 3.1 Flash Lite Preview
Gemini 3.1 Flash Lite Preview
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview Customtools
Gemini 3.5 Flash
Gemini 3.5 Flash Lite
Gemini 3.6 Flash
Gemini 3.7 Flash
Gemini 3.8 Flash
Gemini Flash Latest
Gemma 4 26B A4B IT
Gemma 4 31B IT
MiniMax
Mistral
Codestral 2508
Codestral Latest
Devstral 2512
Devstral Latest
GLM-5.2
Magistral Medium Latest
Magistral Small Latest
Ministral 14B 2512
Ministral 14B Latest
Ministral 3B 2512
Ministral 3B Latest
Ministral 8B 2512
Ministral 8B Latest
Mistral Code Latest
Mistral Large 2512
Mistral Large Latest
Mistral Medium
Mistral Medium 2604
Mistral Medium 3
Mistral Medium 3.5
Mistral Medium Latest
Mistral NeMo
Mistral Small 2603
Mistral Small Latest
Voxtral Small 2507
Voxtral Small Latest
Zai GLM-5
Zai GLM-5.2
Zai GLM-5.3
Zai GLM-Latest
Moonshot AI
NVIDIA
DeepSeek v4 Flash 0731
DeepSeek v4 Pro 0813
Diffusiongemma 26B A4B IT
Gemma 4 31B IT
GLiNER PII
GLM-5.3 Flash
GPT-OSS 120B
GPT-OSS 20B
Kimi K3
Laguna Xs 2.1
Llama 3.1 NemoGuard 8B Topic Control
Llama 3.1 Nemotron Nano 8B v1
Llama 3.1 Nemotron Safety Guard 8B v3
Llama 3.1 Nemotron Ultra 253B v1
Llama 3.2 11B Vision Instruct
Llama 3.2 90B Vision Instruct
Llama 3.3 Nemotron Super 49B v1
Llama 3.3 Nemotron Super 49B v1.5
MiniMax M3
Mistral Nemotron
Muse Glimmer 30B
NemoGuard Jailbreak Detect
Nemotron 3 Nano 30B A3B
Nemotron 3 Nano Omni 30B A3B Reasoning
Nemotron 3 Super 120B A12B
Nemotron 3 Ultra
Nemotron 3 Ultra 550B A55B
Nemotron 3.5 Lightning 30B A3B
Nemotron Content Safety Reasoning 4B
Nemotron Mini 4B Instruct
Riva Translate 4B Instruct v1.1
USDCode Llama 3.1 70B Instruct
OpenAI
ChatGPT 4o Latest
GPT-3.5 Turbo
GPT-3.5 Turbo 0125
GPT-3.5 Turbo 1106
GPT-3.5 Turbo 16K
GPT-4
GPT-4 0613
GPT-4 Turbo
GPT-4 Turbo 2024-04-09
GPT-4.1
GPT-4.1 Mini
GPT-4.1 Nano
GPT-4o
GPT-4o 2024-11-20
GPT-4o mini
GPT-5
GPT-5 Chat Latest
GPT-5 Mini
GPT-5 Nano
GPT-5.1
GPT-5.1 Codex
GPT-5.1 Codex Max
GPT-5.2
GPT-5.2
GPT-5.2 Codex
GPT-5.2 Pro
GPT-5.3 Codex
GPT-5.3 Codex
GPT-5.3 Codex Spark
GPT-5.4
GPT-5.4
GPT-5.4 Mini
GPT-5.4 Mini
GPT-5.4 Nano
GPT-5.4 Pro
GPT-5.4 Pro
GPT-5.5
GPT-5.5
GPT-5.5 Pro
GPT-5.5 Pro
GPT-5.6
GPT-5.6 Luna
GPT-5.6 Luna
GPT-5.6 Sol
GPT-5.6 Sol
GPT-5.6 Terra
GPT-5.6 Terra
GPT-6 Astra
GPT-6 Luna
GPT-6 Sol
GPT-6.1 Sol
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
o1
o1-mini
o1-preview
o3
o3-mini
o3-pro
o4-mini
Opencode Go
Perplexity
Thinking Machines
Vertex
xAI
Xiaomi
Related sampling parameters
Temperature
temperature
Top P
top_p
Frequency penalty
frequency_penalty
Presence penalty
presence_penalty
Top K
extra_body.top_k
Temperature
inferenceConfig.temperature
Top P
inferenceConfig.topP
Seed
seed
Seed
generationConfig.seed
Temperature
generationConfig.temperature
Top K
generationConfig.topK
Top P
generationConfig.topP