NVIDIA H100 GPU rental

Hopper architecture with 80 GB of HBM3 memory per GPU. The H100 SXM reference configuration supports large language model inference, fine-tuning and distributed training.

Check the console or contact sales for prices and available instance configurations.

GPU memory
80 GB HBM3
Memory bandwidth
3.35 TB/s
Architecture
Hopper
Core capabilities

For large-model training and inference

H100 combines fourth-generation Tensor Cores, the Hopper Transformer Engine and fourth-generation NVLink. Select software and topology to match the model, precision and communication requirements.

80 GB HBM3 memory

Budget memory for model weights, KV cache and runtime state. Training also requires space for activations, gradients and optimizer state; parameter count alone does not determine the required GPU count.

FP8 Transformer Engine

Hopper Transformer Engine supports FP8 alongside higher-precision computation. FP8 requires compatible frameworks, kernels and numerical validation; it is not applied automatically to every model.

Fourth-generation NVLink

H100 SXM provides 900 GB/s of aggregate bidirectional NVLink bandwidth per GPU. Actual GPU connectivity depends on the server platform, NVSwitch configuration and allocated GPUs.

Second-generation MIG

The hardware can partition one GPU into up to seven isolated GPU instances. MIG availability, partition size and access mode depend on the actual rental configuration.

Workloads

What can you run on H100 SXM?

From model serving to distributed training, select resources for the workload's memory, compute precision and GPU communication needs.

Run models with Hopper-compatible FP8 kernels and Transformer Engine. Validate numerical accuracy and fallback precision; H100 does not provide native FP4 Tensor Core computation.

Budget the 80 GB HBM3 memory for weights, KV cache and runtime buffers. Context length, batch size and concurrent requests determine how much memory remains for serving.

Include activations, gradients and optimizer state alongside model weights. Plan checkpoint storage and I/O, and check whether the training state needs to be distributed across GPUs.

Evaluate the parallel strategy against the actual NVLink topology and its 900 GB/s aggregate bidirectional bandwidth per GPU. Cross-node training also needs separately confirmed network interfaces, switching and host resources.

Technical specifications

H100 SXM 80 GB reference specifications

These values describe the H100 SXM 80 GB GPU, not H100 PCIe or H100 NVL. Theoretical Tensor Core peaks do not represent measured model throughput or the CPU, memory, storage and network of a complete instance.

H100 SXM 80 GB reference specifications
SpecificationValue per GPU
ArchitectureHopperHopper GPU architecture.
GPU memory80 GB HBM3Stores model weights, KV cache and runtime state.
Memory bandwidth3.35 TB/sData transfer bandwidth between the GPU and local HBM3 memory.
FP8 Tensor compute · Dense1,979 TFLOPSTheoretical peak for dense Tensor Core operations.
FP8 Tensor compute · Sparse3,958 TFLOPSTheoretical peak under the applicable structured-sparsity conditions.
GPU interconnect900 GB/s · NVLink 4Aggregate bidirectional GPU-to-GPU bandwidth within compatible HGX systems.

Deployment configuration

Before renting, confirm CPU, system memory, storage, networking, deployment region, pricing, and delivery arrangements.

GPU and host resources
Check GPU count, available GPU memory, CPU cores and system RAM per instance against your model, data preparation and concurrency needs.
Storage and interconnect
Confirm storage type, capacity and persistence. For multiple GPUs or nodes, also check the GPU interconnect, network bandwidth and topology.
Region and rental period
Match the deployment region, start date and rental period to your data location and usage plans. Confirm availability for the chosen configuration.
Pricing and delivery
Review the billing unit, included resources, delivery schedule and access method. Confirm whether storage, network traffic and other charges are included in the quote.
  • SOC 2 Type II audited

  • ISO/IEC 27001 certified

  • GDPR compliant

Find the GPU for your workload

Compare rental options, explore GPU specifications, then discuss configuration and delivery with our team.

Rent a GPU nowNVIDIAB300Explore B300 specificationsNVIDIAB200Explore B200 specificationsNVIDIAH200Explore H200 specificationsNVIDIAA100Explore A100 specificationsNVIDIARTX 5090Explore RTX 5090 specifications
H100

What a GPU-hour costs right now.

Check the console or contact sales for prices and available instance configurations.

Market referenceUSD per GPU-hour
$2.74
30d

Check the console or contact sales for prices and available instance configurations.

Selection and rental

Frequently asked questions

Distinguish GPU specifications, system platforms and the actual delivered configuration.

Are H100 SXM, PCIe and NVL the same configuration?

No. This page uses the 80 GB HBM3 SXM reference. H100 PCIe has different specifications; H100 NVL uses 94 GB per GPU and a different interconnect arrangement. Confirm the exact SKU rather than combining specifications from these variants.

Does H100 support FP8 and FP4?

Hopper supports FP8 Tensor Core computation through compatible software and Transformer Engine. H100 does not provide Blackwell's native FP4 Tensor Core path. Choose precision only after checking model accuracy, framework support and available kernels.

Is 900 GB/s NVLink the cross-node network speed?

No. It is the aggregate bidirectional NVLink bandwidth per H100 SXM GPU. Communication between servers depends on the installed network interfaces, switching fabric and cluster topology, which must be confirmed separately.

How do I confirm a configuration and quote?

Provide the GPU quantity, preferred region, start date and rental duration, plus any CPU, system memory, storage and network requirements. Review the specific instance, GPU topology, available capacity and quote in the console or with sales.

Rent NVIDIA H100 SXM GPUs

View configurations, or submit your GPU quantity, region and rental term for a quote.