All GPUs
AMD · CDNA 3
AMD Instinct MI300X
A proven 192 GB accelerator for serving large models on a single GPU.
- On-demand
- 2 years
- 3 years
Specifications
- Architecture
- CDNA 3
- GPU memory
- 192 GB HBM3
- Memory bandwidth
- 5.3 TB/s
- GPU-to-GPU
- AMD Infinity Fabric
- Form factor
- OAM
Best for
- Single-GPU serving of large models
- Inference and fine-tuning on ROCm
- Cost-efficient high-memory capacity