GPU model · price + stock · hourly snapshot
Nvidia H100 NVL cloud rental prices
3 providers list the Nvidia H100 NVL, 1 has it in stock. Prices run from $3.03 to $3.16 per GPU hour — the same card, 1.0x apart.
LIVE Prices and stock checked 1 minute ago
Providers
Every provider renting the Nvidia H100 NVL
| Provider | From | Stock | Grab |
|---|---|---|---|
| Vast.ai | $3.03 | In stock | Grab |
| Runpod | $2.59 | Not reported | Grab |
| Massed Compute | $3.16 | Out of stock | Grab |
In stock first, then cheapest. Stock is what the provider reported at our last check. One GPU for a month (730h) at $3.03: $2,211.
The Nvidia H100 NVL sells out fast. Get one email when it is back in stock.
Price history
Price trend
$2.59 /GPU/hr · Oct 22
One point per day: the lowest listed $/GPU/hr across every provider we track, captured daily. 7 offers in the latest snapshot.
Configurations
All 7 configurations
| Configuration | VRAM | Per GPU/hr | Stock |
|---|---|---|---|
| 1x H100 NVLVast.ai | 94 GB | $3.03 | In stock |
| 1x H100 NVLRunpod | 94 GB | $2.59 | Not reported |
| 8x H100_nvlMassed Compute | 752 GB | $3.16 | Out of stock |
| 2x H100_nvlMassed Compute | 188 GB | $3.16 | Out of stock |
| 2x H100_nvlMassed Compute | 188 GB | $3.16 | Out of stock |
| 4x H100_nvlMassed Compute | 376 GB | $3.16 | Out of stock |
| 4x H100_nvlMassed Compute | 376 GB | $3.16 | Out of stock |
Model fit
What fits in 94 GB
The question behind most rentals: will the model load. Sized against one Nvidia H100 NVL.
| Model | 16-bit | 8-bit | 4-bit |
|---|---|---|---|
| DeepSeek-V3 DeepSeek · 671B params · 37B active | 1,610 GB 18× · 82 GB free | 805 GB 9× · 41 GB free | 403 GB 5× · 67 GB free |
| Llama 3.1 405B Meta · 405B params | 972 GB 11× · 62 GB free | 486 GB 6× · 78 GB free | 243 GB 3× · 39 GB free |
| Qwen3 235B-A22B Alibaba · 235B params · 22B active | 564 GB 6× · 0 GB free | 282 GB 3× · 0 GB free | 141 GB 2× · 47 GB free |
| Mixtral 8x22B Mistral · 141B params · 39B active | 338 GB 4× · 38 GB free | 169 GB 2× · 19 GB free | 85 GB 1× · 9 GB free |
| Mistral Large 2 Mistral · 123B params | 295 GB 4× · 81 GB free | 148 GB 2× · 40 GB free | 74 GB 1× · 20 GB free |
| gpt-oss-120b OpenAI · 117B params · 5.1B active | 281 GB 3× · 1 GB free | 140 GB 2× · 48 GB free | 70 GB 1× · 24 GB free |
| Qwen2.5 72B Alibaba · 72.7B params | 174 GB 2× · 14 GB free | 87 GB 1× · 7 GB free | 44 GB 1× · 50 GB free |
| Llama 3.3 70B Meta · 70.6B params | 169 GB 2× · 19 GB free | 85 GB 1× · 9 GB free | 42 GB 1× · 52 GB free |
| Qwen3 32B Alibaba · 32.8B params | 79 GB 1× · 15 GB free | 39 GB 1× · 55 GB free | 20 GB 1× · 74 GB free |
| Gemma 2 27B Google · 27.2B params | 65 GB 1× · 29 GB free | 33 GB 1× · 61 GB free | 16 GB 1× · 78 GB free |
| Mistral Small 3 Mistral · 24B params | 58 GB 1× · 36 GB free | 29 GB 1× · 65 GB free | 14 GB 1× · 80 GB free |
| Llama 3.1 8B Meta · 8B params | 19 GB 1× · 75 GB free | 10 GB 1× · 84 GB free | 5 GB 1× · 89 GB free |
Required memory is weights plus 20% for KV cache and runtime at short context; long contexts and large batches need more. Cells tinted green fit on a single Nvidia H100 NVL.
Specifications
Nvidia H100 NVL specifications
| Architecture | Hopper |
|---|---|
| Memory per GPU | 94 GB HBM3 |
| Memory bandwidth | 3,900 GB/s |
| Release date | Q1 2023 |
| GPU interconnect | NVLink bridge 600 GB/s, pairs |
| FP8 compute rate | 1,671 TFLOPS (dense), 3,341 with sparsity |
| FP16 / BF16 compute rate | 835.5 TFLOPS (dense), 1,671 with sparsity |
| INT8 compute rate | 1,671 TOPS (dense), 3,341 with sparsity |
| Process node | TSMC 4N |
| Board power | 350–400 W |
| Partitioning | MIG, up to 7 instances |
Alternatives