Sampling
integer
61 models
Top K
top_k
Limits token sampling to the top K most likely next tokens.
- Type
- integer
- Default
- varies by model
- Range
- 0 – 100
top_k by model
The exact type, default, range, and conditions for top_k on each model that documents it.
| Model | Provider | Type | Default | Range / values | Condition |
|---|---|---|---|---|---|
| Claude 3 Opus 20240229 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3 Opus Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet 20250219 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 20251001 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Haiku 4.5 20251001 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Opus 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Opus 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 20250929 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 20250929 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| DeepSeek v4 Flash 0731 | Fireworks | integer | — | 1…100 | — |
| DeepSeek v4 Pro | Fireworks | integer | — | 1…100 | — |
| DeepSeek v4 Pro 0813 | Fireworks | integer | — | 1…100 | — |
| GLM-5p2 | Fireworks | integer | — | 1…100 | — |
| GPT-OSS 120B | Fireworks | integer | — | 1…100 | — |
| GPT-OSS 20B | Fireworks | integer | — | 1…100 | — |
| Inkling | Fireworks | integer | — | 1…100 | — |
| Kimi K2p6 | Fireworks | integer | — | 1…100 | — |
| Kimi K2p7 Code | Fireworks | integer | — | 1…100 | — |
| Kimi K3 | Fireworks | integer | — | 1…100 | — |
| MiniMax M2p7 | Fireworks | integer | — | 1…100 | — |
| MiniMax M3 | Fireworks | integer | — | 1…100 | — |
| Muse Glimmer 30B | Fireworks | integer | — | 1…100 | — |
| Qwen3p7 Plus | Fireworks | integer | — | 1…100 | — |
| Qwen3p8 2p4t A95B | Fireworks | integer | — | 1…100 | — |
| Qwen3p8 Max | Fireworks | integer | — | 1…100 | — |
| Gemma 3 12B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 1B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 27B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3 4B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3n E2B IT | integer | 64 | 0…+∞ | — | |
| Gemma 3n E4B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 12B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 E2B IT | integer | 64 | 0…+∞ | — | |
| Gemma 4 E4B IT | integer | 64 | 0…+∞ | — | |
| Llama 3.3 70B Instruct | Meta | integer | — | — | — |
| Llama 3.3 8B Instruct | Meta | integer | — | — | — |
| Llama 4 Maverick 17B 128E Instruct FP8 | Meta | integer | — | — | — |
| Llama 4 Scout 17B 16E Instruct FP8 | Meta | integer | — | — | — |
Models without top_k documented yet
top_k documented yet
These models don't list top_k in the catalog. That may mean the provider doesn't accept it, or it simply hasn't been added yet — the data is community-maintained.
Alibaba
DeepSeek v3.2
DeepSeek v4 Flash
DeepSeek v4 Flash 0731
DeepSeek v4 Pro
DeepSeek v4 Pro 0813
GLM-5.1
GLM-5.2
Kimi K2.7 Code
Qwen Flash
Qwen Max
Qwen Plus
Qwen Turbo
Qwen3 235B A22B Thinking 2507
Qwen3 30B A3B Instruct 2507
Qwen3 30B A3B Thinking 2507
Qwen3 Coder Flash
Qwen3 Coder Next
Qwen3 Coder Plus
Qwen3 Max
Qwen3 Next 80B A3B Instruct
Qwen3 Next 80B A3B Thinking
Qwen3 Vl 235B A22B Instruct
Qwen3 Vl 235B A22B Thinking
Qwen3.5
Qwen3.5 122B A10B
Qwen3.5 27B
Qwen3.5 35B A3B
Qwen3.5 397B A17B
Qwen3.5 Flash
Qwen3.6 27B
Qwen3.6 35B A3B
Qwen3.6 Flash
Qwen3.6 Max Preview
Qwen3.6 Plus
Qwen3.7 Flash
Qwen3.7 Max
Qwen3.7 Plus
Qwen3.8 2.4t A95B
Qwen3.8 27B
Qwen3.8 Max
QwQ Plus
Anthropic
Bedrock
Claude Haiku 4.5
Claude Opus 4.5 20251101
Claude Opus 4.6
Claude Sonnet 4.5
Claude Sonnet 4.6
DeepSeek R1
DeepSeek v3.2
Devstral 2 123B
Gemma 3 12B IT
Gemma 3 27B IT
Gemma 3 4B IT
GLM-4.7
GLM-4.7 Flash
GLM-5
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
Kimi K2 Thinking
Kimi K2.5
Llama3 1 70B Instruct
Llama3 1 8B Instruct
Llama3 3 70B Instruct
Llama3 70B Instruct
Llama3 8B Instruct
Magistral Small 2509
MiniMax M2
MiniMax M2.1
MiniMax M2.5
Ministral 3 14B Instruct
Ministral 3 3B Instruct
Ministral 3 8B Instruct
Mistral 7B Instruct
Mistral Large 2402
Mistral Large 3 675B Instruct
Mistral Small 2402
Mixtral 8x7b Instruct
Nemotron Nano 12B
Nemotron Nano 3 30B
Nemotron Nano 9B
Nemotron Super 3 120B
Nova 2 Lite
Nova Lite
Nova Micro
Nova Pro
Palmyra Vision 7B
Palmyra X4
Palmyra X5
Pixtral Large 2502
Qwen3 32B
Qwen3 Coder 30B A3B
Qwen3 Coder Next
Qwen3 Next 80B A3B
Qwen3 Vl 235B A22B
Voxtral Mini 3B 2507
Voxtral Small 24B 2507
Cerebras
Cohere
Gemini 2.5 Flash
Gemini 2.5 Flash
Gemini 2.5 Flash Lite
Gemini 2.5 Flash Lite
Gemini 2.5 Pro
Gemini 2.5 Pro
Gemini 3 Flash Preview
Gemini 3 Flash Preview
Gemini 3.1 Flash Lite
Gemini 3.1 Flash Lite
Gemini 3.1 Flash Lite Preview
Gemini 3.1 Flash Lite Preview
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview Customtools
Gemini 3.5 Flash
Gemini 3.5 Flash Lite
Gemini 3.6 Flash
Gemini 3.7 Flash
Gemini Flash Latest
Gemma 4 26B A4B IT
Gemma 4 31B IT
MiniMax
Mistral
Codestral 2508
Codestral Latest
Devstral 2512
Devstral Latest
Magistral Medium Latest
Magistral Small Latest
Ministral 14B 2512
Ministral 14B Latest
Ministral 3B 2512
Ministral 3B Latest
Ministral 8B 2512
Ministral 8B Latest
Mistral Large 2512
Mistral Large Latest
Mistral Medium 3
Mistral Medium 3.5
Mistral Medium Latest
Mistral NeMo
Mistral Small 2603
Mistral Small Latest
Moonshot AI
NVIDIA
DeepSeek v4 Flash 0731
GLiNER PII
Llama 3.1 NemoGuard 8B Topic Control
Llama 3.1 Nemotron Nano 8B v1
Llama 3.1 Nemotron Safety Guard 8B v3
Llama 3.1 Nemotron Ultra 253B v1
Llama 3.3 Nemotron Super 49B v1
Llama 3.3 Nemotron Super 49B v1.5
NemoGuard Jailbreak Detect
Nemotron 3 Nano 30B A3B
Nemotron 3 Super 120B A12B
Nemotron 3 Ultra
Nemotron 3 Ultra 550B A55B
Nemotron Content Safety Reasoning 4B
Nemotron Mini 4B Instruct
Riva Translate 4B Instruct v1.1
USDCode Llama 3.1 70B Instruct
OpenAI
ChatGPT 4o Latest
GPT-3.5 Turbo
GPT-3.5 Turbo 16K
GPT-4
GPT-4 0613
GPT-4 Turbo
GPT-4 Turbo 2024-04-09
GPT-4.1
GPT-4.1 Mini
GPT-4.1 Nano
GPT-4o
GPT-4o 2024-11-20
GPT-4o mini
GPT-5
GPT-5 Chat Latest
GPT-5 Mini
GPT-5 Nano
GPT-5.1
GPT-5.1 Codex
GPT-5.1 Codex Max
GPT-5.2
GPT-5.2
GPT-5.2 Codex
GPT-5.3 Codex
GPT-5.3 Codex
GPT-5.3 Codex Spark
GPT-5.4
GPT-5.4
GPT-5.4 Mini
GPT-5.4 Mini
GPT-5.4 Nano
GPT-5.4 Pro
GPT-5.4 Pro
GPT-5.5
GPT-5.5
GPT-5.5 Pro
GPT-5.5 Pro
GPT-5.6
GPT-5.6 Luna
GPT-5.6 Luna
GPT-5.6 Sol
GPT-5.6 Sol
GPT-5.6 Terra
GPT-5.6 Terra
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
o1
o1-mini
o1-preview
o3
o3-mini
o3-pro
o4-mini
Perplexity
Thinking Machines
Vertex
xAI
Xiaomi
Related sampling parameters
Temperature
temperature
Top P
top_p
Frequency penalty
frequency_penalty
Presence penalty
presence_penalty
Temperature
inferenceConfig.temperature
Top P
inferenceConfig.topP
Top K
extra_body.top_k
Seed
seed
Seed
generationConfig.seed
Temperature
generationConfig.temperature
Top K
generationConfig.topK
Top P
generationConfig.topP