Card | Price per hour2 | FP32 (ML benchmarks score)1 | FP64, TFLOPS (peak) | Memory, GB | CUDA cores |
A100 by Puzl | $1.60 | 1 | 9.7 | 40 HBM2 | 13824 |
Half of A100 by Puzl, based on Nvidia MIG | $0.80 x0.5 | 0.57 | 4.85 x0.5 | 20 HBM2 | 5925 x0.43 |
Quarter of A100 by Puzl, based on Nvidia MIG | $0.40 x0.25 | 0.284 | 2.43 x0.25 | 10 HBM2 | 3950 x0.29 |
A4000 | $0.46 x0.29 | 0.347 | 0.6 x0.06 | 16 GDDR6 | 6144 x0.44 |
A5000 | $0.84 x0.52 | 0.546 | 0.87 x0.09 | 24 GDDR6 | 8192 x0.59 |
Tesla T4 | $0.26 x0.16 | 0.138 | 0.25 x0.03 | 16 GDDR6 | 2560 x0.19 |
Tesla V100 | $1.17 x0.73 | 0.415 | 7 x0.72 | 16 HBM2 | 5120 x0.37 |
* Benchmarks are made on instances with 1 GPU, 16GB RAM, 4vCPU and fast storage with similar IOPS and bandwidth rate.
** Based on average normalized GPU score for ResNet, Inception and AlexNet benchmarks. Normalization was performed to A100 score (1 is a score of A100).
*** The minimum market price per 1 GPU on demand, taken from public price lists of popular cloud and hosting providers. Information is current as of February 2022.
**** Values for MIG based GPUs are approximate. Find more details about Nvidia MIG technology here.
Commit to consistent usage of GPU-hours and get reserved GPUs under a discounted price.
*AMD, and the AMD Arrow logo, AMD EPYC and combinations thereof are trademarks of Advanced Micro Devices, Inc.
With 2nd generation AMD processors you can allocate 196 vCPU and 10 GPU in one instance.
Fast, reliable data storage for your datasets and trained models, runtime-extensible up to 4TB.
DDR4 ECC 2.9Ghz memory with flexible allocation up to 1TB.