AI Tools Hub
Roundup· 1 min

What an H100 costs per hour, by provider

Prices checked on each vendor's pricing page in November 2026. Hourly equivalents for per-second and per-minute billing are our own calculation.

AI Tools Hub Editorial · published · updated

H100 hourly rates

ProviderFormPer hour
Together AICluster, preemptible$1.99
Together AICluster, reserved 3–180 days$3.19–$3.69
Together AICluster, on demand$3.99
ModalPer-second (H100 SXM5)~$3.95
Together AIDedicated inference$5.49
ReplicateH100$5.49
BasetenDedicated deployment~$6.50
FireworksOn demand H100 80GB$8.00
Not strictly like for like — clusters you operate yourself, dedicated inference includes the serving layer.

Three bands

Preemptible at $1.99 suits work that can be interrupted: batch embedding, offline evaluation, overnight training. You must build the resume logic yourself.

Reserved suits predictable load and saves roughly 20% against on demand. On demand suits experiments and unknown load, and is where you should start.

Check before comparing rates

  • Whether the GPU is actually available
  • Whether pinning a region adds a premium — Fireworks charges 1.5x
  • Separate storage and egress charges
  • Minimum terms and cancellation

FAQ

Can preemptible be used in production?

Not where a user is waiting. It suits batch and training work that can restart.

Related

More articles