Live · serverless · 2 regions
Mistral Large 3
by Mistral AI
Mistral's largest open model, a mixture-of-experts design for long documents, tool use and European languages.
- chat
- vision
- FP8
Serverless priceUSD
- Input
- $0.65per 1M tokens
- Output
- $1.60per 1M tokens
Billed per token, no minimums.
Reference
Specifications
- Model ID
- Endpoint
- Publisher
- Tasks
- Served context
- Quantization
- Decode speed
- p50 first token
- Regions
- Dedicated
Last 24 hours
Latency and speed
Median of each 15-minute step on the shared pool, measured at the API edge. Time to first token includes queueing; decode speed is for one request.
Time to first token · ms
270 msmedian
p95 288 ms
Decode speed · tok/s
58 tok/smedian
p5 54 tok/s
Show the data
| Step | Time to first token | Decode speed |
|---|---|---|
| 15m ago | 287 ms | 58 tok/s |
| 30m ago | 274 ms | 57 tok/s |
| 45m ago | 270 ms | 57 tok/s |
| 1h ago | 279 ms | 56 tok/s |
| 1h 15m ago | 280 ms | 57 tok/s |
| 1h 30m ago | 282 ms | 58 tok/s |
| 1h 45m ago | 267 ms | 60 tok/s |
| 2h ago | 275 ms | 57 tok/s |
| 2h 15m ago | 287 ms | 57 tok/s |
| 2h 30m ago | 281 ms | 58 tok/s |
| 2h 45m ago | 268 ms | 60 tok/s |
| 3h ago | 269 ms | 59 tok/s |
| 3h 15m ago | 279 ms | 59 tok/s |
| 3h 30m ago | 268 ms | 58 tok/s |
| 3h 45m ago | 275 ms | 56 tok/s |
| 4h ago | 287 ms | 58 tok/s |
| 4h 15m ago | 277 ms | 56 tok/s |
| 4h 30m ago | 274 ms | 58 tok/s |
| 4h 45m ago | 285 ms | 57 tok/s |
| 5h ago | 265 ms | 59 tok/s |
| 5h 15m ago | 278 ms | 59 tok/s |
| 5h 30m ago | 286 ms | 56 tok/s |
| 5h 45m ago | 280 ms | 57 tok/s |
| 6h ago | 288 ms | 54 tok/s |
| 6h 15m ago | 285 ms | 57 tok/s |
| 6h 30m ago | 264 ms | 60 tok/s |
| 6h 45m ago | 287 ms | 55 tok/s |
| 7h ago | 272 ms | 59 tok/s |
| 7h 15m ago | 281 ms | 56 tok/s |
| 7h 30m ago | 274 ms | 59 tok/s |
| 7h 45m ago | 263 ms | 59 tok/s |
| 8h ago | 278 ms | 56 tok/s |
| 8h 15m ago | 268 ms | 58 tok/s |
| 8h 30m ago | 261 ms | 57 tok/s |
| 8h 45m ago | 283 ms | 56 tok/s |
| 9h ago | 270 ms | 59 tok/s |
| 9h 15m ago | 275 ms | 56 tok/s |
| 9h 30m ago | 272 ms | 58 tok/s |
| 9h 45m ago | 271 ms | 60 tok/s |
| 10h ago | 270 ms | 58 tok/s |
| 10h 15m ago | 258 ms | 59 tok/s |
| 10h 30m ago | 276 ms | 58 tok/s |
| 10h 45m ago | 261 ms | 58 tok/s |
| 11h ago | 255 ms | 61 tok/s |
| 11h 15m ago | 263 ms | 59 tok/s |
| 11h 30m ago | 261 ms | 58 tok/s |
| 11h 45m ago | 265 ms | 60 tok/s |
| 12h ago | 255 ms | 61 tok/s |
| 12h 15m ago | 345 ms | 51 tok/s |
| 12h 30m ago | 272 ms | 57 tok/s |
| 12h 45m ago | 255 ms | 59 tok/s |
| 13h ago | 269 ms | 60 tok/s |
| 13h 15m ago | 272 ms | 58 tok/s |
| 13h 30m ago | 253 ms | 61 tok/s |
| 13h 45m ago | 260 ms | 59 tok/s |
| 14h ago | 261 ms | 60 tok/s |
| 14h 15m ago | 246 ms | 60 tok/s |
| 14h 30m ago | 260 ms | 59 tok/s |
| 14h 45m ago | 248 ms | 62 tok/s |
| 15h ago | 343 ms | 51 tok/s |
| 15h 15m ago | 260 ms | 58 tok/s |
| 15h 30m ago | 264 ms | 60 tok/s |
| 15h 45m ago | 267 ms | 58 tok/s |
| 16h ago | 268 ms | 57 tok/s |
| 16h 15m ago | 247 ms | 62 tok/s |
| 16h 30m ago | 270 ms | 58 tok/s |
| 16h 45m ago | 247 ms | 62 tok/s |
| 17h ago | 256 ms | 61 tok/s |
| 17h 15m ago | 329 ms | 53 tok/s |
| 17h 30m ago | 264 ms | 58 tok/s |
| 17h 45m ago | 273 ms | 57 tok/s |
| 18h ago | 265 ms | 60 tok/s |
| 18h 15m ago | 267 ms | 60 tok/s |
| 18h 30m ago | 270 ms | 56 tok/s |
| 18h 45m ago | 271 ms | 57 tok/s |
| 19h ago | 367 ms | 46 tok/s |
| 19h 15m ago | 259 ms | 58 tok/s |
| 19h 30m ago | 263 ms | 60 tok/s |
| 19h 45m ago | 273 ms | 58 tok/s |
| 20h ago | 259 ms | 58 tok/s |
| 20h 15m ago | 272 ms | 57 tok/s |
| 20h 30m ago | 258 ms | 61 tok/s |
| 20h 45m ago | 276 ms | 56 tok/s |
| 21h ago | 276 ms | 56 tok/s |
| 21h 15m ago | 270 ms | 59 tok/s |
| 21h 30m ago | 259 ms | 58 tok/s |
| 21h 45m ago | 262 ms | 58 tok/s |
| 22h ago | 270 ms | 60 tok/s |
| 22h 15m ago | 272 ms | 59 tok/s |
| 22h 30m ago | 263 ms | 60 tok/s |
| 22h 45m ago | 275 ms | 59 tok/s |
| 23h ago | 278 ms | 59 tok/s |
| 23h 15m ago | 273 ms | 56 tok/s |
| 23h 30m ago | 281 ms | 58 tok/s |
| 23h 45m ago | 268 ms | 58 tok/s |
| 24h ago | 267 ms | 60 tok/s |
API
Make a request
The same request shape as every other model on /v1/chat/completions. Switching between them is a change to one string.
curl https://api.weir.example/v1/chat/completions \
-H "Authorization: Bearer $WEIR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "mistral-large-3",
"messages": [
{ "role": "user", "content": "What does a KV cache do?" }
]
}'Dedicated
Need reserved capacity?
Mistral Large 3 runs on the shared serverless pool. Dedicated replicas for it are set up on request, with the same API and the same model ID.
Talk to an engineerCompare