NVIDIA GB200 NVL72Submitter CoreWeave
Submission ID 6535925d-129c-42f5-b5a8-5fb6211e0e4c
Submission Status PUBLISHED
Submission Date 2026-06-25
Publication Date —
Division Standardized
Model Name DeepSeek R1
Division Standardized
Model Precision nvfp4
Model Link —
Calibration Link —
Model Notes —
Dataset Name dsr1-perf
Dataset Type performance
Average Input Tokens —
Dataset Link —
System TPS vs. Tokens/s per User
System TPS vs. Concurrency
Time to First Token P95 vs. Concurrency
Tokens/s per User vs. Concurrency
System Name NVIDIA GB200 NVL72
System Availability Available
System Category Datacenter · —
System Size 68x NVIDIA GB200
Node Types 1
Total Node Count 17
Max Supported Concurrency 16,384
Node Type ID 1
Node Count 17
Framework —
Serving Framework —
Inference Backend CUDA 13.2
Driver 595.71.05
Link to Container —
Operating System linux Ubuntu 24.04
Filesystem Not available
Other Software —
Software Notes —
Processor
Processor Model Name Neoverse-V2
Processors per Node 1
Cores Per Processor 144
VCPUs Per Processor 144
Accelerator
Accelerator Model Name NVIDIA GB200
Accelerators per Node 4
Memory Type HBM3e
Memory Capacity 186GiB
Accelerator Interconnect NVLink 5 + NVSwitch (NVL72)
Host-Accelerator Interconnect NVLink-C2C (Grace-Blackwell)
Host / Storage
Host Memory Capacity 956 GB
Memory Configuration —
Storage Capacity 14306 GB
Storage Type —
Networking
Network Interfaces 1x
Network Details NVLink + InfiniBand
Network Topology —
Other
Other Hardware —
Cooling —
Hardware Notes —
| Field Name | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Run 6 | Run 7 | Run 8 | Run 9 | Run 10 |
|---|---|---|---|---|---|---|---|---|---|---|
| Run Date | 06/26/2026 | 06/25/2026 | 06/25/2026 | 06/25/2026 | 06/26/2026 | 06/25/2026 | 06/26/2026 | 06/25/2026 | 06/25/2026 | 06/25/2026 |
| Concurrency | 16 | 32 | 48 | 256 | 512 | 1,024 | 2,048 | 4,096 | 8,192 | 16,384 |
| System Tokens/Second | 4,017.4 | 7,057.3 | 10,485.7 | 46,676.2 | 78,791.9 | 127,635.8 | 193,265.1 | 290,645.5 | 389,090.6 | 441,740.3 |
| Tokens/Second per User | 251.1 | 220.5 | 218.5 | 182.3 | 153.9 | 124.6 | 94.4 | 71.0 | 47.5 | 27.0 |
| TTFT P95 (ms) | 14811.8 | 290.9 | 316.5 | 2262.0 | 1679.0 | 1680.2 | 1362.4 | 4347.9 | 14163.1 | 5770.4 |
| Utilization | 0.9% | 1.6% | 2.4% | 10.6% | 17.8% | 28.9% | 43.8% | 65.8% | 88.1% | 100.0% |
| Configuration Summary | dsr1-gb200x72-pareto-nvl72-c16 · submission | dsr1-gb200x72-pareto-nvl72-c32 · submission | dsr1-gb200x72-pareto-nvl72-c32 · submission · c48 | dsr1-gb200x72-pareto-nvl72-c256 · submission | dsr1-gb200x72-pareto-nvl72-c512 · submission | dsr1-gb200x72-pareto-nvl72-c1024 · submission | dsr1-gb200x72-pareto-nvl72-c2048 · submission | dsr1-gb200x72-pareto-nvl72-c4096 · submission | dsr1-gb200x72-pareto-nvl72-c8192 · submission | dsr1-gb200x72-pareto-nvl72-c16384 · submission |
| Config Type | submission | submission | submission | submission | submission | submission | submission | submission | submission | submission |
| Config Region | — | — | — | — | — | — | — | — | — | — |
| Target QPS | — | — | — | — | — | — | — | — | — | — |
| Result State | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete |
| Measured Accuracy Score | — | — | — | — | — | — | — | — | — | — |
| Benchmark Version | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 |
| Result Version | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 |
| Archive URI | gs://mlperf-endpoints-blob/runs/543bf208-1752-456a-9023-2b9def7fc888/archive.tar.gz | gs://mlperf-endpoints-blob/runs/ac882870-e1ae-4144-bbf1-0607920db278/archive.tar.gz | gs://mlperf-endpoints-blob/runs/b5fc9d3e-d626-4d35-ba82-ca3b016187a9/archive.tar.gz | gs://mlperf-endpoints-blob/runs/52394b12-bfe2-4413-90a3-5786bda92e14/archive.tar.gz | gs://mlperf-endpoints-blob/runs/934f515f-0f69-4583-89de-9bea66f01af1/archive.tar.gz | gs://mlperf-endpoints-blob/runs/46db041f-c562-4d54-9e02-64266005dcef/archive.tar.gz | gs://mlperf-endpoints-blob/runs/d9b32918-a093-4434-9c50-44f1dc5e41e0/archive.tar.gz | gs://mlperf-endpoints-blob/runs/45ea80ed-771f-4da4-98c3-cd4259354122/archive.tar.gz | gs://mlperf-endpoints-blob/runs/76e09625-871d-43d7-9a92-a50f4f523d96/archive.tar.gz | gs://mlperf-endpoints-blob/runs/6646e4e5-afd0-4442-a52c-fd2f2aa06315/archive.tar.gz |
| QPS | 1.1090 | 1.8750 | 2.7833 | 12.3678 | 20.9545 | 33.8391 | 51.5138 | 77.4180 | 103.9316 | 117.0239 |
| Total Output Tokens | 15,576,844 | 28,605,489 | 28,631,907 | 185,304,678 | 311,716,324 | 499,015,460 | 756,721,191 | 1,144,291,853 | 1,413,627,513 | 1,710,733,049 |
| Average Output Tokens | 3,622.52 | 3,763.88 | 3,767.36 | 3,774.03 | 3,760.15 | 3,771.85 | 3,751.72 | 3,754.24 | 3,743.72 | 3,774.79 |
| Run Duration (s) | 3,877.39 | 4,053.30 | 2,730.58 | 3,970.00 | 3,956.20 | 3,909.68 | 3,915.46 | 3,937.07 | 3,633.16 | 3,872.71 |
| Total Queries | 4,300 | 7,600 | 7,600 | 49,100 | 82,900 | 132,300 | 201,700 | 304,800 | 377,600 | 453,200 |
| Total Queries Issued | 4,300 | 7,600 | 7,600 | 49,100 | 82,900 | 132,300 | 201,700 | 304,800 | 377,600 | 453,200 |
| Total Queries Failed | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Time to First Token (TTFT) P95 (ms) | ||||||||||
| Minimum | 139.7 | 146.1 | 150.9 | 157.1 | 170.7 | 168.3 | 200.2 | 200.5 | 199.5 | 176.3 |
| Average | 3175.9 | 199.6 | 225.9 | 680.9 | 616.1 | 584.0 | 621.6 | 1371.8 | 2997.1 | 1464.6 |
| P50 | 237.5 | 171.8 | 187.3 | 336.4 | 422.5 | 317.2 | 367.7 | 371.7 | 514.2 | 329.0 |
| P90 | 10113.4 | 262.4 | 297.0 | 1671.1 | 1207.5 | 1290.4 | 1044.7 | 3073.9 | 5298.7 | 404.0 |
| P95 | 14811.8 | 290.9 | 316.5 | 2262.0 | 1679.0 | 1680.2 | 1362.4 | 4347.9 | 14163.1 | 5770.4 |
| P99 | 24302.7 | 336.0 | 364.0 | 3427.9 | 3113.8 | 2900.3 | 6120.6 | 17842.8 | 45355.5 | 33413.1 |
| P999 | 35571.5 | 2438.4 | 2807.0 | 4534.3 | 4983.8 | 8406.9 | 15793.0 | 31734.1 | 63584.2 | 43135.4 |
| Maximum | 46355.1 | 2863.0 | 3151.8 | 5743.7 | 5004.9 | 9035.2 | 17665.4 | 34197.3 | 67197.3 | 44868.4 |
| Time Per Output Token (TPOT) (ms) | ||||||||||
| Minimum | 0.00 | 0.84 | 0.01 | 2.62 | 2.37 | 1.97 | 1.96 | 2.33 | 5.28 | 6.53 |
| Average | 3.18 | 4.52 | 4.54 | 5.35 | 6.36 | 7.88 | 10.4 | 13.6 | 19.4 | 34.8 |
| P50 | 3.14 | 4.47 | 4.49 | 5.30 | 6.30 | 7.81 | 10.4 | 13.6 | 19.6 | 35.6 |
| P90 | 3.59 | 4.98 | 5.01 | 5.92 | 7.04 | 8.75 | 11.6 | 15.2 | 20.6 | 38.2 |
| P95 | 3.67 | 5.09 | 5.10 | 6.04 | 7.18 | 8.92 | 11.9 | 15.5 | 20.8 | 38.8 |
| P99 | 3.82 | 5.25 | 5.27 | 6.26 | 7.43 | 9.23 | 12.3 | 16.1 | 21.2 | 39.7 |
| P999 | 4.00 | 5.48 | 5.50 | 6.50 | 7.73 | 9.61 | 12.8 | 16.8 | 21.6 | 40.6 |
| Maximum | 4.32 | 5.59 | 5.64 | 7.04 | 8.27 | 10.5 | 14.2 | 18.0 | 22.9 | 43.4 |
| Query Latency (ms) | ||||||||||
| Minimum | 793.5 | 1069.9 | 1001.2 | 1122.1 | 1196.4 | 1371.9 | 1494.0 | 1915.5 | 3176.8 | 4847.7 |
| Average | 14381.2 | 16772.1 | 16880.4 | 20351.1 | 23941.9 | 29547.8 | 38755.3 | 51260.0 | 74849.5 | 131201.6 |
| P50 | 10005.6 | 9561.1 | 9727.2 | 11929.7 | 13933.1 | 17172.4 | 22353.8 | 29909.6 | 44498.3 | 74738.7 |
| P90 | 32199.3 | 41480.4 | 41297.4 | 49578.2 | 58127.4 | 72564.0 | 96045.5 | 125891.4 | 182685.4 | 324380.7 |
| P95 | 45049.1 | 58435.7 | 58475.1 | 70747.7 | 82611.8 | 102971.4 | 135723.4 | 178905.9 | 257187.4 | 457239.2 |
| P99 | 61756.5 | 83988.3 | 82490.6 | 99282.5 | 117924.4 | 145864.1 | 193059.2 | 253234.2 | 376737.6 | 671764.0 |
| P999 | 72460.7 | 91330.7 | 90509.5 | 107746.4 | 128241.0 | 158353.6 | 209822.7 | 276608.7 | 392739.4 | 727381.0 |
| Maximum | 92203.2 | 97798.1 | 93067.2 | 120302.8 | 154702.5 | 182600.6 | 261548.6 | 360922.4 | 408893.9 | 754525.7 |