Sampling
integer
36 models
Top K
top_k
Limits token sampling to the top K most likely next tokens.
- Type
- integer
- Default
- 0
- Range
- 0 – +∞
top_k by model
The exact type, default, range, and conditions for top_k on each model that documents it.
| Model | Provider | Type | Default | Range / values | Condition |
|---|---|---|---|---|---|
| Claude 3 Opus 20240229 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3 Opus Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Haiku Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet 20241022 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.5 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet 20250219 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude 3.7 Sonnet Latest | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Haiku 4.5 20251001 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Haiku 4.5 20251001 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Opus 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.1 20250805 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.5 20251101 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Opus 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Opus 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4 20250514 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4 20250514 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"adaptive", "enabled"}
|
| Claude Sonnet 4.5 20250929 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.5 20250929 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type = "enabled"
|
| Claude Sonnet 4.6 | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Claude Sonnet 4.6 Subscription | Anthropic | integer | 0 | 0…+∞ |
Not when thinking.type ∈ {"enabled", "adaptive"}
|
| Llama 3.3 70B Instruct | Meta | integer | — | — | — |
| Llama 3.3 8B Instruct | Meta | integer | — | — | — |
| Llama 4 Maverick 17B 128E Instruct FP8 | Meta | integer | — | — | — |
| Llama 4 Scout 17B 16E Instruct FP8 | Meta | integer | — | — | — |
Models without top_k documented yet
top_k documented yet
These models don't list top_k in the catalog. That may mean the provider doesn't accept it, or it simply hasn't been added yet — the data is community-maintained.
Alibaba
Anthropic
Cohere
MiniMax
Mistral
Moonshot AI
Nvidia
Gliner Pii
Llama 3.1 Nemoguard 8b Topic Control
Llama 3.1 Nemotron Nano 8b V1
Llama 3.1 Nemotron Safety Guard 8b V3
Llama 3.1 Nemotron Ultra 253b V1
Llama 3.3 Nemotron Super 49b V1
Llama 3.3 Nemotron Super 49b V1.5
Nemoguard Jailbreak Detect
Nemotron 3 Nano 30b A3b
Nemotron 3 Super 120b A12b
Nemotron 3 Ultra
Nemotron 3 Ultra 550b A55b
Nemotron Content Safety Reasoning 4b
Nemotron Mini 4b Instruct
Riva Translate 4b Instruct V1.1
Usdcode Llama 3.1 70b Instruct
OpenAI
Chatgpt 4o Latest
Gpt 3.5 Turbo
Gpt 4 Turbo
Gpt 4 Turbo 2024-04-09
Gpt 4.1
Gpt 4.1 Mini
Gpt 4.1 Nano
Gpt 4o 2024-11-20
Gpt 5
Gpt 5 Chat Latest
Gpt 5 Mini
Gpt 5 Nano
Gpt 5.1
Gpt 5.1 Codex
Gpt 5.1 Codex Max
Gpt 5.2
Gpt 5.2
Gpt 5.2 Codex
Gpt 5.3 Codex
Gpt 5.3 Codex
Gpt 5.3 Codex Spark
Gpt 5.4
Gpt 5.4
Gpt 5.4 Mini
Gpt 5.4 Mini
Gpt 5.4 Nano
Gpt 5.4 Pro
Gpt 5.4 Pro
Gpt 5.5
Gpt 5.5
Gpt 5.5 Pro
Gpt 5.5 Pro
GPT-4o
GPT-4o mini
o1
O1 Preview
o1-mini
o3
O3 Pro
o3-mini
o4-mini
Perplexity
xAI
Xiaomi
Related sampling parameters
Temperature
temperature
Top P
top_p
Frequency penalty
frequency_penalty
Presence penalty
presence_penalty
Seed
seed
Do sample
do_sample
Random seed
random_seed
Seed
generationConfig.seed
Temperature
generationConfig.temperature
Top K
generationConfig.topK
Top P
generationConfig.topP
Top K
extra_body.top_k