Live · serverless · 3 regions
Gemma 3 27B
by Google
A 27B model that reads images and text in more than 140 languages and runs on a single H100.
- chat
- vision
- BF16
- dedicated
Serverless priceUSD
- Input
- $0.20per 1M tokens
- Output
- $0.40per 1M tokens
Billed per token, no minimums.
Reference
Specifications
- Model ID
- Endpoint
- Publisher
- Tasks
- Served context
- Quantization
- Decode speed
- p50 first token
- Regions
- Dedicated
Last 24 hours
Latency and speed
Median of each 15-minute step on the shared pool, measured at the API edge. Time to first token includes queueing; decode speed is for one request.
Time to first token · ms
135 msmedian
p95 180 ms
Decode speed · tok/s
140 tok/smedian
p5 119 tok/s
Show the data
| Step | Time to first token | Decode speed |
|---|---|---|
| 15m ago | 202 ms | 109 tok/s |
| 30m ago | 198 ms | 105 tok/s |
| 45m ago | 135 ms | 136 tok/s |
| 1h ago | 133 ms | 145 tok/s |
| 1h 15m ago | 146 ms | 138 tok/s |
| 1h 30m ago | 138 ms | 141 tok/s |
| 1h 45m ago | 143 ms | 137 tok/s |
| 2h ago | 136 ms | 137 tok/s |
| 2h 15m ago | 135 ms | 142 tok/s |
| 2h 30m ago | 139 ms | 140 tok/s |
| 2h 45m ago | 139 ms | 138 tok/s |
| 3h ago | 139 ms | 136 tok/s |
| 3h 15m ago | 136 ms | 135 tok/s |
| 3h 30m ago | 143 ms | 132 tok/s |
| 3h 45m ago | 139 ms | 137 tok/s |
| 4h ago | 138 ms | 136 tok/s |
| 4h 15m ago | 137 ms | 139 tok/s |
| 4h 30m ago | 134 ms | 137 tok/s |
| 4h 45m ago | 180 ms | 119 tok/s |
| 5h ago | 139 ms | 136 tok/s |
| 5h 15m ago | 136 ms | 141 tok/s |
| 5h 30m ago | 145 ms | 133 tok/s |
| 5h 45m ago | 136 ms | 141 tok/s |
| 6h ago | 132 ms | 141 tok/s |
| 6h 15m ago | 142 ms | 135 tok/s |
| 6h 30m ago | 142 ms | 138 tok/s |
| 6h 45m ago | 136 ms | 135 tok/s |
| 7h ago | 136 ms | 139 tok/s |
| 7h 15m ago | 133 ms | 137 tok/s |
| 7h 30m ago | 139 ms | 139 tok/s |
| 7h 45m ago | 139 ms | 137 tok/s |
| 8h ago | 139 ms | 137 tok/s |
| 8h 15m ago | 133 ms | 144 tok/s |
| 8h 30m ago | 140 ms | 140 tok/s |
| 8h 45m ago | 138 ms | 141 tok/s |
| 9h ago | 138 ms | 137 tok/s |
| 9h 15m ago | 136 ms | 137 tok/s |
| 9h 30m ago | 133 ms | 140 tok/s |
| 9h 45m ago | 127 ms | 141 tok/s |
| 10h ago | 137 ms | 143 tok/s |
| 10h 15m ago | 127 ms | 144 tok/s |
| 10h 30m ago | 128 ms | 147 tok/s |
| 10h 45m ago | 133 ms | 144 tok/s |
| 11h ago | 138 ms | 142 tok/s |
| 11h 15m ago | 129 ms | 139 tok/s |
| 11h 30m ago | 133 ms | 143 tok/s |
| 11h 45m ago | 129 ms | 143 tok/s |
| 12h ago | 124 ms | 141 tok/s |
| 12h 15m ago | 136 ms | 138 tok/s |
| 12h 30m ago | 130 ms | 140 tok/s |
| 12h 45m ago | 132 ms | 141 tok/s |
| 13h ago | 175 ms | 120 tok/s |
| 13h 15m ago | 126 ms | 141 tok/s |
| 13h 30m ago | 128 ms | 147 tok/s |
| 13h 45m ago | 129 ms | 139 tok/s |
| 14h ago | 123 ms | 145 tok/s |
| 14h 15m ago | 130 ms | 141 tok/s |
| 14h 30m ago | 126 ms | 143 tok/s |
| 14h 45m ago | 156 ms | 126 tok/s |
| 15h ago | 131 ms | 142 tok/s |
| 15h 15m ago | 130 ms | 144 tok/s |
| 15h 30m ago | 131 ms | 139 tok/s |
| 15h 45m ago | 135 ms | 142 tok/s |
| 16h ago | 132 ms | 141 tok/s |
| 16h 15m ago | 127 ms | 144 tok/s |
| 16h 30m ago | 128 ms | 147 tok/s |
| 16h 45m ago | 124 ms | 143 tok/s |
| 17h ago | 132 ms | 145 tok/s |
| 17h 15m ago | 133 ms | 137 tok/s |
| 17h 30m ago | 123 ms | 142 tok/s |
| 17h 45m ago | 128 ms | 145 tok/s |
| 18h ago | 136 ms | 138 tok/s |
| 18h 15m ago | 133 ms | 141 tok/s |
| 18h 30m ago | 127 ms | 141 tok/s |
| 18h 45m ago | 127 ms | 146 tok/s |
| 19h ago | 137 ms | 135 tok/s |
| 19h 15m ago | 126 ms | 145 tok/s |
| 19h 30m ago | 131 ms | 145 tok/s |
| 19h 45m ago | 134 ms | 142 tok/s |
| 20h ago | 131 ms | 140 tok/s |
| 20h 15m ago | 135 ms | 142 tok/s |
| 20h 30m ago | 137 ms | 141 tok/s |
| 20h 45m ago | 128 ms | 145 tok/s |
| 21h ago | 129 ms | 143 tok/s |
| 21h 15m ago | 137 ms | 135 tok/s |
| 21h 30m ago | 133 ms | 137 tok/s |
| 21h 45m ago | 140 ms | 133 tok/s |
| 22h ago | 137 ms | 141 tok/s |
| 22h 15m ago | 133 ms | 137 tok/s |
| 22h 30m ago | 136 ms | 136 tok/s |
| 22h 45m ago | 196 ms | 106 tok/s |
| 23h ago | 190 ms | 114 tok/s |
| 23h 15m ago | 138 ms | 140 tok/s |
| 23h 30m ago | 144 ms | 133 tok/s |
| 23h 45m ago | 133 ms | 140 tok/s |
| 24h ago | 143 ms | 140 tok/s |
API
Make a request
The same request shape as every other model on /v1/chat/completions. Switching between them is a change to one string.
curl https://api.weir.example/v1/chat/completions \
-H "Authorization: Bearer $WEIR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "gemma-3-27b",
"messages": [
{ "role": "user", "content": "What does a KV cache do?" }
]
}'Dedicated
Run it on GPUs reserved for you
- Replica
- 1× H100
- Replica rate
- $2.49 / hour
- Peak throughput
- 6,000 tok/s
- Break-even, 1 replica
- 6.06B tok/mo
Replicas reserved for you, billed by the second, with a 99.95% monthly uptime SLA. Break-even is where one replica costs the same as serverless, at half input and half output tokens.
Compare