Sampling
integer
33 models
Top K
generationConfig.topK
Limits token sampling to the top K most likely next tokens.
- Type
- integer
- Default
- 64
- Range
- 0 – +∞
generationConfig.topK by model
The exact type, default, range, and conditions for generationConfig.topK on each model that documents it.
Models without generationConfig.topK documented yet
generationConfig.topK documented yet
These models don't list generationConfig.topK in the catalog. That may mean the provider doesn't accept it, or it simply hasn't been added yet — the data is community-maintained.
Alibaba
DeepSeek v3.2
DeepSeek v4 Flash
DeepSeek v4 Flash 0731
DeepSeek v4 Pro
DeepSeek v4 Pro 0813
GLM-5.1
GLM-5.2
Kimi K2.7 Code
Qwen Flash
Qwen Max
Qwen Plus
Qwen Turbo
Qwen3 235B A22B Thinking 2507
Qwen3 30B A3B Instruct 2507
Qwen3 30B A3B Thinking 2507
Qwen3 Coder Flash
Qwen3 Coder Next
Qwen3 Coder Plus
Qwen3 Max
Qwen3 Next 80B A3B Instruct
Qwen3 Next 80B A3B Thinking
Qwen3 Vl 235B A22B Instruct
Qwen3 Vl 235B A22B Thinking
Qwen3.5
Qwen3.5 122B A10B
Qwen3.5 27B
Qwen3.5 35B A3B
Qwen3.5 397B A17B
Qwen3.5 Flash
Qwen3.6 27B
Qwen3.6 35B A3B
Qwen3.6 Flash
Qwen3.6 Max Preview
Qwen3.6 Plus
Qwen3.7 Flash
Qwen3.7 Max
Qwen3.7 Plus
Qwen3.8 2.4t A95B
Qwen3.8 27B
Qwen3.8 Max
QwQ Plus
Anthropic
Claude 3 Opus 20240229
Claude 3 Opus Latest
Claude 3.5 Haiku 20241022
Claude 3.5 Haiku Latest
Claude 3.5 Sonnet 20241022
Claude 3.5 Sonnet Latest
Claude 3.7 Sonnet 20250219
Claude 3.7 Sonnet Latest
Claude Fable 5
Claude Fable 5
Claude Haiku 4
Claude Haiku 4
Claude Haiku 4.5
Claude Haiku 4.5
Claude Haiku 4.5 20251001
Claude Haiku 4.5 20251001
Claude Opus 4
Claude Opus 4 20250514
Claude Opus 4 20250514
Claude Opus 4.1 20250805
Claude Opus 4.1 20250805
Claude Opus 4.5 20251101
Claude Opus 4.5 20251101
Claude Opus 4.6
Claude Opus 4.6
Claude Opus 4.7
Claude Opus 4.7
Claude Opus 4.8
Claude Opus 4.8
Claude Opus 5
Claude Opus 5
Claude Sonnet 4
Claude Sonnet 4 20250514
Claude Sonnet 4 20250514
Claude Sonnet 4.5
Claude Sonnet 4.5
Claude Sonnet 4.5 20250929
Claude Sonnet 4.5 20250929
Claude Sonnet 4.6
Claude Sonnet 4.6
Claude Sonnet 5
Claude Sonnet 5
Bedrock
Claude Haiku 4.5
Claude Opus 4.5 20251101
Claude Opus 4.6
Claude Sonnet 4.5
Claude Sonnet 4.6
DeepSeek R1
DeepSeek v3.2
Devstral 2 123B
Gemma 3 12B IT
Gemma 3 27B IT
Gemma 3 4B IT
GLM-4.7
GLM-4.7 Flash
GLM-5
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
Kimi K2 Thinking
Kimi K2.5
Llama3 1 70B Instruct
Llama3 1 8B Instruct
Llama3 3 70B Instruct
Llama3 70B Instruct
Llama3 8B Instruct
Magistral Small 2509
MiniMax M2
MiniMax M2.1
MiniMax M2.5
Ministral 3 14B Instruct
Ministral 3 3B Instruct
Ministral 3 8B Instruct
Mistral 7B Instruct
Mistral Large 2402
Mistral Large 3 675B Instruct
Mistral Small 2402
Mixtral 8x7b Instruct
Nemotron Nano 12B
Nemotron Nano 3 30B
Nemotron Nano 9B
Nemotron Super 3 120B
Nova 2 Lite
Nova Lite
Nova Micro
Nova Pro
Palmyra Vision 7B
Palmyra X4
Palmyra X5
Pixtral Large 2502
Qwen3 32B
Qwen3 Coder 30B A3B
Qwen3 Coder Next
Qwen3 Next 80B A3B
Qwen3 Vl 235B A22B
Voxtral Mini 3B 2507
Voxtral Small 24B 2507
Cerebras
Cohere
Fireworks
Meta
MiniMax
Mistral
Codestral 2508
Codestral Latest
Devstral 2512
Devstral Latest
Magistral Medium Latest
Magistral Small Latest
Ministral 14B 2512
Ministral 14B Latest
Ministral 3B 2512
Ministral 3B Latest
Ministral 8B 2512
Ministral 8B Latest
Mistral Large 2512
Mistral Large Latest
Mistral Medium 3
Mistral Medium 3.5
Mistral Medium Latest
Mistral NeMo
Mistral Small 2603
Mistral Small Latest
Moonshot AI
NVIDIA
DeepSeek v4 Flash 0731
GLiNER PII
Llama 3.1 NemoGuard 8B Topic Control
Llama 3.1 Nemotron Nano 8B v1
Llama 3.1 Nemotron Safety Guard 8B v3
Llama 3.1 Nemotron Ultra 253B v1
Llama 3.3 Nemotron Super 49B v1
Llama 3.3 Nemotron Super 49B v1.5
NemoGuard Jailbreak Detect
Nemotron 3 Nano 30B A3B
Nemotron 3 Super 120B A12B
Nemotron 3 Ultra
Nemotron 3 Ultra 550B A55B
Nemotron Content Safety Reasoning 4B
Nemotron Mini 4B Instruct
Riva Translate 4B Instruct v1.1
USDCode Llama 3.1 70B Instruct
OpenAI
ChatGPT 4o Latest
GPT-3.5 Turbo
GPT-3.5 Turbo 16K
GPT-4
GPT-4 0613
GPT-4 Turbo
GPT-4 Turbo 2024-04-09
GPT-4.1
GPT-4.1 Mini
GPT-4.1 Nano
GPT-4o
GPT-4o 2024-11-20
GPT-4o mini
GPT-5
GPT-5 Chat Latest
GPT-5 Mini
GPT-5 Nano
GPT-5.1
GPT-5.1 Codex
GPT-5.1 Codex Max
GPT-5.2
GPT-5.2
GPT-5.2 Codex
GPT-5.3 Codex
GPT-5.3 Codex
GPT-5.3 Codex Spark
GPT-5.4
GPT-5.4
GPT-5.4 Mini
GPT-5.4 Mini
GPT-5.4 Nano
GPT-5.4 Pro
GPT-5.4 Pro
GPT-5.5
GPT-5.5
GPT-5.5 Pro
GPT-5.5 Pro
GPT-5.6
GPT-5.6 Luna
GPT-5.6 Luna
GPT-5.6 Sol
GPT-5.6 Sol
GPT-5.6 Terra
GPT-5.6 Terra
GPT-OSS 120B
GPT-OSS 20B
GPT-OSS Safeguard 120B
GPT-OSS Safeguard 20B
o1
o1-mini
o1-preview
o3
o3-mini
o3-pro
o4-mini
Perplexity
Thinking Machines
xAI
Xiaomi
Related sampling parameters
Temperature
temperature
Top P
top_p
Frequency penalty
frequency_penalty
Presence penalty
presence_penalty
Top K
top_k
Temperature
inferenceConfig.temperature
Top P
inferenceConfig.topP
Top K
extra_body.top_k
Seed
seed
Seed
generationConfig.seed
Temperature
generationConfig.temperature
Top P
generationConfig.topP