Live · serverless · 2 regions
Llama 4 Maverick
by Meta
A larger mixture-of-experts model that reads images and text and gives more careful answers than Scout.
- chat
- vision
- FP8
Serverless priceUSD
- Input
- $0.27per 1M tokens
- Output
- $0.85per 1M tokens
Billed per token, no minimums.
Reference
Specifications
- Model ID
- Endpoint
- Publisher
- Tasks
- Served context
- Quantization
- Decode speed
- p50 first token
- Regions
- Dedicated
Last 24 hours
Latency and speed
Median of each 15-minute step on the shared pool, measured at the API edge. Time to first token includes queueing; decode speed is for one request.
Time to first token · ms
165 msmedian
p95 179 ms
Decode speed · tok/s
118 tok/smedian
p5 111 tok/s
Show the data
| Step | Time to first token | Decode speed |
|---|---|---|
| 15m ago | 168 ms | 117 tok/s |
| 30m ago | 170 ms | 118 tok/s |
| 45m ago | 171 ms | 116 tok/s |
| 1h ago | 170 ms | 115 tok/s |
| 1h 15m ago | 173 ms | 118 tok/s |
| 1h 30m ago | 172 ms | 119 tok/s |
| 1h 45m ago | 173 ms | 118 tok/s |
| 2h ago | 170 ms | 117 tok/s |
| 2h 15m ago | 172 ms | 113 tok/s |
| 2h 30m ago | 175 ms | 111 tok/s |
| 2h 45m ago | 164 ms | 120 tok/s |
| 3h ago | 165 ms | 120 tok/s |
| 3h 15m ago | 179 ms | 114 tok/s |
| 3h 30m ago | 173 ms | 118 tok/s |
| 3h 45m ago | 167 ms | 116 tok/s |
| 4h ago | 178 ms | 117 tok/s |
| 4h 15m ago | 165 ms | 119 tok/s |
| 4h 30m ago | 173 ms | 115 tok/s |
| 4h 45m ago | 176 ms | 114 tok/s |
| 5h ago | 177 ms | 114 tok/s |
| 5h 15m ago | 174 ms | 118 tok/s |
| 5h 30m ago | 164 ms | 117 tok/s |
| 5h 45m ago | 163 ms | 119 tok/s |
| 6h ago | 241 ms | 90 tok/s |
| 6h 15m ago | 164 ms | 119 tok/s |
| 6h 30m ago | 162 ms | 117 tok/s |
| 6h 45m ago | 163 ms | 118 tok/s |
| 7h ago | 163 ms | 117 tok/s |
| 7h 15m ago | 160 ms | 122 tok/s |
| 7h 30m ago | 165 ms | 117 tok/s |
| 7h 45m ago | 160 ms | 120 tok/s |
| 8h ago | 175 ms | 114 tok/s |
| 8h 15m ago | 171 ms | 117 tok/s |
| 8h 30m ago | 167 ms | 118 tok/s |
| 8h 45m ago | 168 ms | 117 tok/s |
| 9h ago | 164 ms | 121 tok/s |
| 9h 15m ago | 161 ms | 123 tok/s |
| 9h 30m ago | 160 ms | 120 tok/s |
| 9h 45m ago | 166 ms | 120 tok/s |
| 10h ago | 160 ms | 117 tok/s |
| 10h 15m ago | 169 ms | 117 tok/s |
| 10h 30m ago | 161 ms | 120 tok/s |
| 10h 45m ago | 164 ms | 119 tok/s |
| 11h ago | 164 ms | 118 tok/s |
| 11h 15m ago | 154 ms | 124 tok/s |
| 11h 30m ago | 157 ms | 125 tok/s |
| 11h 45m ago | 169 ms | 117 tok/s |
| 12h ago | 168 ms | 120 tok/s |
| 12h 15m ago | 164 ms | 117 tok/s |
| 12h 30m ago | 163 ms | 116 tok/s |
| 12h 45m ago | 154 ms | 125 tok/s |
| 13h ago | 207 ms | 100 tok/s |
| 13h 15m ago | 167 ms | 115 tok/s |
| 13h 30m ago | 161 ms | 122 tok/s |
| 13h 45m ago | 157 ms | 124 tok/s |
| 14h ago | 167 ms | 115 tok/s |
| 14h 15m ago | 157 ms | 124 tok/s |
| 14h 30m ago | 156 ms | 123 tok/s |
| 14h 45m ago | 152 ms | 125 tok/s |
| 15h ago | 164 ms | 121 tok/s |
| 15h 15m ago | 151 ms | 125 tok/s |
| 15h 30m ago | 163 ms | 122 tok/s |
| 15h 45m ago | 165 ms | 121 tok/s |
| 16h ago | 157 ms | 118 tok/s |
| 16h 15m ago | 157 ms | 122 tok/s |
| 16h 30m ago | 153 ms | 121 tok/s |
| 16h 45m ago | 154 ms | 120 tok/s |
| 17h ago | 214 ms | 104 tok/s |
| 17h 15m ago | 168 ms | 117 tok/s |
| 17h 30m ago | 156 ms | 119 tok/s |
| 17h 45m ago | 167 ms | 116 tok/s |
| 18h ago | 162 ms | 120 tok/s |
| 18h 15m ago | 156 ms | 119 tok/s |
| 18h 30m ago | 168 ms | 114 tok/s |
| 18h 45m ago | 163 ms | 117 tok/s |
| 19h ago | 165 ms | 122 tok/s |
| 19h 15m ago | 154 ms | 124 tok/s |
| 19h 30m ago | 155 ms | 123 tok/s |
| 19h 45m ago | 164 ms | 118 tok/s |
| 20h ago | 157 ms | 121 tok/s |
| 20h 15m ago | 165 ms | 120 tok/s |
| 20h 30m ago | 171 ms | 117 tok/s |
| 20h 45m ago | 159 ms | 121 tok/s |
| 21h ago | 170 ms | 116 tok/s |
| 21h 15m ago | 170 ms | 119 tok/s |
| 21h 30m ago | 167 ms | 121 tok/s |
| 21h 45m ago | 169 ms | 120 tok/s |
| 22h ago | 172 ms | 118 tok/s |
| 22h 15m ago | 169 ms | 115 tok/s |
| 22h 30m ago | 167 ms | 116 tok/s |
| 22h 45m ago | 175 ms | 113 tok/s |
| 23h ago | 217 ms | 101 tok/s |
| 23h 15m ago | 172 ms | 117 tok/s |
| 23h 30m ago | 167 ms | 119 tok/s |
| 23h 45m ago | 176 ms | 116 tok/s |
| 24h ago | 165 ms | 121 tok/s |
API
Make a request
The same request shape as every other model on /v1/chat/completions. Switching between them is a change to one string.
curl https://api.weir.example/v1/chat/completions \
-H "Authorization: Bearer $WEIR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "llama-4-maverick",
"messages": [
{ "role": "user", "content": "What does a KV cache do?" }
]
}'Dedicated
Need reserved capacity?
Llama 4 Maverick runs on the shared serverless pool. Dedicated replicas for it are set up on request, with the same API and the same model ID.
Talk to an engineerCompare