Live · serverless · 2 regions
Qwen3 235B A22B
by Alibaba
A large mixture-of-experts model with a switchable thinking mode, strong on multilingual and math-heavy prompts.
- chat
- reasoning
- FP8
Serverless priceUSD
- Input
- $0.22per 1M tokens
- Output
- $0.88per 1M tokens
Billed per token, no minimums.
Reference
Specifications
- Model ID
- Endpoint
- Publisher
- Tasks
- Served context
- Quantization
- Decode speed
- p50 first token
- Regions
- Dedicated
Last 24 hours
Latency and speed
Median of each 15-minute step on the shared pool, measured at the API edge. Time to first token includes queueing; decode speed is for one request.
Time to first token · ms
240 msmedian
p95 256 ms
Decode speed · tok/s
85 tok/smedian
p5 82 tok/s
Show the data
| Step | Time to first token | Decode speed |
|---|---|---|
| 15m ago | 239 ms | 84 tok/s |
| 30m ago | 248 ms | 83 tok/s |
| 45m ago | 251 ms | 84 tok/s |
| 1h ago | 247 ms | 83 tok/s |
| 1h 15m ago | 260 ms | 80 tok/s |
| 1h 30m ago | 246 ms | 82 tok/s |
| 1h 45m ago | 255 ms | 81 tok/s |
| 2h ago | 255 ms | 84 tok/s |
| 2h 15m ago | 247 ms | 85 tok/s |
| 2h 30m ago | 244 ms | 84 tok/s |
| 2h 45m ago | 240 ms | 86 tok/s |
| 3h ago | 259 ms | 83 tok/s |
| 3h 15m ago | 245 ms | 83 tok/s |
| 3h 30m ago | 249 ms | 86 tok/s |
| 3h 45m ago | 256 ms | 83 tok/s |
| 4h ago | 242 ms | 83 tok/s |
| 4h 15m ago | 239 ms | 86 tok/s |
| 4h 30m ago | 246 ms | 85 tok/s |
| 4h 45m ago | 259 ms | 83 tok/s |
| 5h ago | 255 ms | 84 tok/s |
| 5h 15m ago | 255 ms | 84 tok/s |
| 5h 30m ago | 245 ms | 84 tok/s |
| 5h 45m ago | 242 ms | 84 tok/s |
| 6h ago | 252 ms | 83 tok/s |
| 6h 15m ago | 254 ms | 84 tok/s |
| 6h 30m ago | 245 ms | 83 tok/s |
| 6h 45m ago | 249 ms | 86 tok/s |
| 7h ago | 254 ms | 80 tok/s |
| 7h 15m ago | 233 ms | 88 tok/s |
| 7h 30m ago | 234 ms | 84 tok/s |
| 7h 45m ago | 246 ms | 85 tok/s |
| 8h ago | 245 ms | 86 tok/s |
| 8h 15m ago | 244 ms | 86 tok/s |
| 8h 30m ago | 243 ms | 82 tok/s |
| 8h 45m ago | 243 ms | 86 tok/s |
| 9h ago | 232 ms | 86 tok/s |
| 9h 15m ago | 239 ms | 86 tok/s |
| 9h 30m ago | 249 ms | 82 tok/s |
| 9h 45m ago | 312 ms | 75 tok/s |
| 10h ago | 239 ms | 88 tok/s |
| 10h 15m ago | 231 ms | 89 tok/s |
| 10h 30m ago | 231 ms | 86 tok/s |
| 10h 45m ago | 247 ms | 83 tok/s |
| 11h ago | 246 ms | 86 tok/s |
| 11h 15m ago | 226 ms | 87 tok/s |
| 11h 30m ago | 235 ms | 87 tok/s |
| 11h 45m ago | 240 ms | 84 tok/s |
| 12h ago | 223 ms | 90 tok/s |
| 12h 15m ago | 242 ms | 86 tok/s |
| 12h 30m ago | 241 ms | 87 tok/s |
| 12h 45m ago | 238 ms | 87 tok/s |
| 13h ago | 222 ms | 91 tok/s |
| 13h 15m ago | 243 ms | 84 tok/s |
| 13h 30m ago | 223 ms | 88 tok/s |
| 13h 45m ago | 239 ms | 83 tok/s |
| 14h ago | 222 ms | 90 tok/s |
| 14h 15m ago | 224 ms | 91 tok/s |
| 14h 30m ago | 239 ms | 86 tok/s |
| 14h 45m ago | 230 ms | 87 tok/s |
| 15h ago | 234 ms | 86 tok/s |
| 15h 15m ago | 229 ms | 89 tok/s |
| 15h 30m ago | 233 ms | 87 tok/s |
| 15h 45m ago | 229 ms | 90 tok/s |
| 16h ago | 222 ms | 87 tok/s |
| 16h 15m ago | 241 ms | 84 tok/s |
| 16h 30m ago | 236 ms | 84 tok/s |
| 16h 45m ago | 223 ms | 87 tok/s |
| 17h ago | 237 ms | 86 tok/s |
| 17h 15m ago | 234 ms | 87 tok/s |
| 17h 30m ago | 230 ms | 87 tok/s |
| 17h 45m ago | 238 ms | 84 tok/s |
| 18h ago | 243 ms | 83 tok/s |
| 18h 15m ago | 245 ms | 84 tok/s |
| 18h 30m ago | 233 ms | 87 tok/s |
| 18h 45m ago | 240 ms | 87 tok/s |
| 19h ago | 230 ms | 87 tok/s |
| 19h 15m ago | 240 ms | 86 tok/s |
| 19h 30m ago | 231 ms | 89 tok/s |
| 19h 45m ago | 225 ms | 87 tok/s |
| 20h ago | 227 ms | 89 tok/s |
| 20h 15m ago | 242 ms | 84 tok/s |
| 20h 30m ago | 250 ms | 82 tok/s |
| 20h 45m ago | 229 ms | 89 tok/s |
| 21h ago | 240 ms | 86 tok/s |
| 21h 15m ago | 235 ms | 84 tok/s |
| 21h 30m ago | 238 ms | 85 tok/s |
| 21h 45m ago | 239 ms | 88 tok/s |
| 22h ago | 232 ms | 84 tok/s |
| 22h 15m ago | 246 ms | 84 tok/s |
| 22h 30m ago | 253 ms | 82 tok/s |
| 22h 45m ago | 234 ms | 88 tok/s |
| 23h ago | 246 ms | 86 tok/s |
| 23h 15m ago | 249 ms | 83 tok/s |
| 23h 30m ago | 247 ms | 83 tok/s |
| 23h 45m ago | 235 ms | 87 tok/s |
| 24h ago | 253 ms | 85 tok/s |
API
Make a request
The same request shape as every other model on /v1/chat/completions. Switching between them is a change to one string.
curl https://api.weir.example/v1/chat/completions \
-H "Authorization: Bearer $WEIR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "qwen3-235b-a22b",
"messages": [
{ "role": "user", "content": "What does a KV cache do?" }
]
}'Dedicated
Need reserved capacity?
Qwen3 235B A22B runs on the shared serverless pool. Dedicated replicas for it are set up on request, with the same API and the same model ID.
Talk to an engineerCompare