NVIDIA A100 GPU rental

Ampere architecture with 80 GB of HBM2e memory per GPU. This page uses the A100 80 GB SXM hardware reference for FP16/BF16 training, fine-tuning and inference; confirm the actual rental variant separately.

Check the console or contact sales for prices and available instance configurations.

GPU memory
80 GB HBM2e
Memory bandwidth
2,039 GB/s
Architecture
Ampere
Core capabilities

For large-model training and inference

A100 combines third-generation Tensor Cores, HBM2e memory and third-generation NVLink. Evaluate memory requirements, supported precision and GPU connectivity against the actual workload and instance configuration.

80 GB HBM2e memory

Allow space for weights, KV cache and runtime buffers. Fine-tuning also needs activations, gradients and optimizer state. An 80 GB GPU does not guarantee that a model will fit at every precision or context length.

FP16 and BF16 Tensor Cores

Third-generation Tensor Cores support FP16, BF16 and TF32 for compatible workloads. A100 does not have the native FP8 or FP4 Tensor Core paths of newer architectures; select kernels and precision accordingly.

Third-generation NVLink

The A100 reference provides 600 GB/s of aggregate bidirectional NVLink bandwidth per GPU. GPU connectivity depends on the SXM platform and topology; the delivered rental configuration must be checked.

Multi-Instance GPU

The hardware can divide one A100 into up to seven isolated GPU instances with dedicated resources. This capability does not imply that MIG partitions are offered in every rental configuration.

Workloads

What can you run on A100 80GB?

From model serving to distributed training, select resources for the workload's memory, compute precision and GPU communication needs.

Run existing training code with Ampere-compatible Tensor Core kernels. Confirm framework, operator and precision support; do not plan around native FP8 or FP4 computation on A100.

Budget the 80 GB HBM2e memory for weights, KV cache and runtime state; fine-tuning adds activations, gradients and optimizer state. Choose context length, batch size and precision from measured memory use.

Each replica needs memory for its model and training state. Evaluate collective communication against the actual 600 GB/s aggregate bidirectional NVLink topology; cross-node jobs also require host and network checks.

Run image, speech or text models with Ampere-compatible CUDA operators. Account for encoder outputs, activations, input resolution and sequence length when estimating memory, and verify each model component's software support.

Technical specifications

A100 80 GB SXM reference specifications

The table describes the 80 GB SXM hardware reference, not a confirmed rental SKU. A100 40 GB and PCIe variants differ. Tensor Core peaks are theoretical and do not describe measured model throughput or a complete server configuration.

A100 80 GB SXM reference specifications
SpecificationValue per GPU
ArchitectureAmpereAmpere GPU architecture.
GPU memory80 GB HBM2eStores model weights, KV cache and runtime state.
Memory bandwidth2,039 GB/sData transfer bandwidth between the GPU and local HBM2e memory.
FP16/BF16 Tensor compute · Dense312 TFLOPSTheoretical peak for dense Tensor Core operations.
FP16/BF16 Tensor compute · Sparse624 TFLOPSTheoretical peak under the applicable structured-sparsity conditions.
GPU interconnect600 GB/s · NVLink 3Aggregate bidirectional GPU-to-GPU bandwidth within compatible HGX systems.

Deployment configuration

Before renting, confirm CPU, system memory, storage, networking, deployment region, pricing, and delivery arrangements.

GPU and host resources
Check GPU count, available GPU memory, CPU cores and system RAM per instance against your model, data preparation and concurrency needs.
Storage and interconnect
Confirm storage type, capacity and persistence. For multiple GPUs or nodes, also check the GPU interconnect, network bandwidth and topology.
Region and rental period
Match the deployment region, start date and rental period to your data location and usage plans. Confirm availability for the chosen configuration.
Pricing and delivery
Review the billing unit, included resources, delivery schedule and access method. Confirm whether storage, network traffic and other charges are included in the quote.
  • SOC 2 Type II audited

  • ISO/IEC 27001 certified

  • GDPR compliant

Find the GPU for your workload

Compare rental options, explore GPU specifications, then discuss configuration and delivery with our team.

Rent a GPU nowNVIDIAB300Explore B300 specificationsNVIDIAB200Explore B200 specificationsNVIDIAH200Explore H200 specificationsNVIDIAH100Explore H100 specificationsNVIDIARTX 5090Explore RTX 5090 specifications
A100

What a GPU-hour costs right now.

Check the console or contact sales for prices and available instance configurations.

Market referenceUSD per GPU-hour
$0.90
30d

Check the console or contact sales for prices and available instance configurations.

Selection and rental

Frequently asked questions

Distinguish GPU specifications, system platforms and the actual delivered configuration.

How does A100 80 GB differ from A100 40 GB?

They have different memory capacities and memory bandwidth. This page uses the 80 GB HBM2e SXM reference. More memory can accommodate larger weights, caches or training state, but it does not directly imply twice the model performance. Check precision, context length and batch size.

Are A100 SXM and PCIe specifications interchangeable?

No. The 80 GB SXM reference has 2,039 GB/s memory bandwidth, while the 80 GB PCIe reference has 1,935 GB/s. Their installation and multi-GPU arrangements also differ. An A100 80GB catalog label alone does not establish which variant will be delivered.

Does A100 provide native FP8 or FP4 Tensor Core computation?

No. A100's Ampere Tensor Cores support FP16, BF16 and TF32, among other formats, but not native FP8 or FP4 Tensor Core computation. The 624 TFLOPS FP16/BF16 value requires supported structured sparsity; dense computation is 312 TFLOPS.

What should be confirmed before renting?

Confirm the exact GPU variant, GPU count, region, start date, duration and CPU, memory, storage and network requirements. The 600 GB/s NVLink reference is not a cross-node network rate. Check GPU topology, available capacity and the quote for the specific instance.

Rent NVIDIA A100 80GB GPUs

View configurations, or submit your GPU quantity, region and rental term for a quote.