Chutes

Node Growth Analytics

GPU node growth patterns over the last 30 days

2.29K
↘ -15.5% vs yesterday

GPU Node Counts

Below are the current counts of GPU nodes on the Chutes platform, with various statistics on the GPUs themselves, and summaries of the total compute currently available.

GPU Node Table

Below are the current counts of GPU nodes on the Chutes platform, with various statistics on the GPUs themselves, and summaries of the total compute currently available.

GPU Name Provisioned Memory CUDA Cores Memory Bandwidth FP32 Performance Max Power
NVIDIA H200 141GB SXM 1355 141 GB HBM3e 16,896 4.8 TB/s 67 TFLOPS 700 W
NVIDIA L40S 181 48 GB GDDR6 (ECC) 18,176 864 GB/s 91.6 TFLOPS 350 W
NVIDIA A100 80GB SXM 164 80 GB HBM2e 6,912 2.039 TB/s 19.5 TFLOPS 400 W
NVIDIA GeForce RTX 3090 162 24 GB GDDR6X 10,496 936 GB/s ~35.7 TFLOPS 350 W
NVIDIA A100 40GB PCIe 114 40 GB HBM2 6,912 1.6 TB/s 19.5 TFLOPS 250 W
NVIDIA GeForce RTX 4090 60 24 GB GDDR6X 16,384 1008 GB/s ~83 TFLOPS 450 W
NVIDIA H100 80GB SXM 56 80 GB HBM3 16,896 3.35 TB/s 67 TFLOPS 700 W
NVIDIA RTX A6000 42 48 GB GDDR6 (ECC) 10,752 768 GB/s 38.7 TFLOPS 300 W
NVIDIA B200 Blackwell 40 192 GB HBM3E 18,000 8 TB/s 160 TFLOPS 700 W
NVIDIA RTX A4000 32 16 GB GDDR6 (ECC) 6,144 448 GB/s 19.2 TFLOPS 140 W
21 N/A N/A N/A N/A N/A
NVIDIA L40 20 48 GB GDDR6 (ECC) 18,176 864 GB/s 90.5 TFLOPS 300 W
NVIDIA A40 19 48 GB GDDR6 (ECC) 10,752 696 GB/s 37.4 TFLOPS 300 W
NVIDIA RTX 6000 Ada Generation 6 48 GB GDDR6 (ECC) 18,176 960 GB/s 91.1 TFLOPS 300 W
NVIDIA L4 Tensor Core GPU 3 24 GB GDDR6 7,680 300 GB/s 30.3 TFLOPS 72 W
NVIDIA A100 80GB PCIe 0 80 GB HBM2e 6,912 1.935 TB/s 19.5 TFLOPS 300 W
NVIDIA A100 40GB SXM 0 40 GB HBM2 6,912 1.6 TB/s 19.5 TFLOPS 400 W
0 N/A N/A N/A N/A N/A
NVIDIA H100 80GB PCIe 0 80 GB HBM3 16,896 3.35 TB/s 60 TFLOPS 350 W
0 N/A N/A N/A N/A N/A
Total 2275 - 33,803,136 - - 1,287,646 W
Chutes

Serverless AI Compute