Skip to content
AuraMatrix
← All posts

2026-11-13

One H100, eight clouds, a 5x price gap. What is in the gap?

Renting one NVIDIA H100 for an hour costs $1.99 on the cheapest list and $10.98 on the dearest. Three things explain most of the spread: the machine around the chip, the network, and whether you can actually get one.

Renting one NVIDIA H100 for one hour costs $1.99 on the cheapest list we track and $10.98 on the dearest. Same chip. Here is the on-demand price per GPU-hour at eight providers:

NVIDIA H100, on demand, USD per GPU-hour, as recorded on 2026-11-13.
ProviderPer GPU-hour
RunPod Community Cloud$1.99
RunPod Secure Cloud$2.89
Lambda$3.79
Together AI$3.99
CoreWeave$6.16
AWS$6.88
Microsoft Azure$6.98
Google Cloud$10.98

The median is $5.07. Three things explain most of the spread.

1. You are not renting a chip, you are renting a machine

Think of the GPU as the stove in a rented kitchen. The stove is the same everywhere; the number of cooks (vCPUs) and the counter space (memory) are not. Per H100, CoreWeave gives 16 vCPUs and 256 GB of memory, AWS 24 and 256 GB, Google Cloud 26 and 234 GB, and Azure's single-GPU machine 40 and 320 GB.

2. The road to the kitchen

For training across many GPUs, the network matters as much as the card. AWS states 3,200 Gbps for its 8-GPU H100 machine and Google Cloud 1,000 Gbps. The cheap lists do not state a figure at all.

3. A price on a list is not a machine you can get

We ask RunPod's API once an hour whether it has stock. The $1.99 H100 has answered "none to rent" every time since we started asking. On the Vast.ai marketplace the median ask moved between $2.20 and $4.64 in three days.

So

The honest answer to "what does an H100 cost?" is a table, not a number: the price, what comes with it, and whether you can actually have it. We publish that table every day, with the source of every figure: the NVIDIA H100 price page. The data is open (CC BY), and you can ask it from your own AI assistant.

List prices as published by each provider, not invoices. Stock is the provider's own statement. The figures here are those recorded on 2026-11-13; the linked page has the current ones.

Free to quote and republish with the credit “Source: AuraMatrix (auramatrix.ai)”.