NVIDIA GB200 NVL72Result statement
CoreWeave ran DeepSeek-R1 on NVIDIA GB200 NVL72 and achieved a verified 441,740.3 tokens/second System TPS at 404.0ms TTFT P90 in the Standardized division of the Available category .
[1] MLPerf Endpoints v1.0 DeepSeek-R1; retrieved from endpoints.mlcommons.org on October 16, 2026. Result —, run 10: concurrency = 16,384 queries, TTFT P90 = 404.0ms, System TPS = 441,740.3 tokens/sec and interactivity = 27.0 tokens/sec per user. Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
CoreWeave
6535925d-129c-42f5-b5a8-5fb6211e0e4c
Submission Status PUBLISHED
2026-06-25
—
Division Standardized
Deployment Client over Network
Model Name DeepSeek-R1
Division Standardized
Model Precision nvfp4
Model Link —
Calibration Link —
Model Notes —
Dataset Name dsr1-perf
Dataset Type performance
Average Input Tokens —
Dataset Link —
System TPS vs. Tokens/s per User
System TPS vs. Concurrency
Time to First Token P90 vs. Concurrency
Tokens/s per User vs. Concurrency
NVIDIA GB200 NVL72
Available
System Category Datacenter · —
68x NVIDIA GB200
1
17
Max Supported Concurrency 16,384
Node Type ID 1
Node Count 17
Framework —
—
CUDA 13.2
595.71.05
Link to Container —
Operating System linux Ubuntu 24.04
Filesystem Not available
Other Software —
Software Notes —
Processor
Neoverse-V2
1
144
VCPUs Per Processor 144
Accelerator
NVIDIA GB200
4
HBM3e
186GiB
NVLink 5 + NVSwitch (NVL72)
NVLink-C2C (Grace-Blackwell)
Host / Storage
956 GB
Memory Configuration —
Storage Capacity 14306 GB
Storage Type —
Networking
1x
NVLink + InfiniBand
Network Topology —
Other
Other Hardware —
Cooling —
Hardware Notes —
| Field Name | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Run 6 | Run 7 | Run 8 | Run 9 | Run 10 |
|---|---|---|---|---|---|---|---|---|---|---|
| Run Date | 06/26/2026 | 06/25/2026 | 06/25/2026 | 06/25/2026 | 06/26/2026 | 06/25/2026 | 06/26/2026 | 06/25/2026 | 06/25/2026 | 06/25/2026 |
| Concurrency | 16 | 32 | 48 | 256 | 512 | 1,024 | 2,048 | 4,096 | 8,192 | 16,384 |
| System Tokens/Second | 4,017.4 | 7,057.3 | 10,485.7 | 46,676.2 | 78,791.9 | 127,635.8 | 193,265.1 | 290,645.5 | 389,090.6 | 441,740.3 |
| Tokens/Second per User | 251.1 | 220.5 | 218.5 | 182.3 | 153.9 | 124.6 | 94.4 | 71.0 | 47.5 | 27.0 |
| TTFT P90 (ms) | 10113.4 | 262.4 | 297.0 | 1671.1 | 1207.5 | 1290.4 | 1044.7 | 3073.9 | 5298.7 | 404.0 |
| Utilization | 0.9% | 1.6% | 2.4% | 10.6% | 17.8% | 28.9% | 43.8% | 65.8% | 88.1% | 100.0% |
| Configuration Summary | dsr1-gb200x72-pareto-nvl72-c16 · submission | dsr1-gb200x72-pareto-nvl72-c32 · submission | dsr1-gb200x72-pareto-nvl72-c32 · submission · c48 | dsr1-gb200x72-pareto-nvl72-c256 · submission | dsr1-gb200x72-pareto-nvl72-c512 · submission | dsr1-gb200x72-pareto-nvl72-c1024 · submission | dsr1-gb200x72-pareto-nvl72-c2048 · submission | dsr1-gb200x72-pareto-nvl72-c4096 · submission | dsr1-gb200x72-pareto-nvl72-c8192 · submission | dsr1-gb200x72-pareto-nvl72-c16384 · submission |
| Config Type | submission | submission | submission | submission | submission | submission | submission | submission | submission | submission |
| Config Region | — | — | — | — | — | — | — | — | — | — |
| Target QPS | — | — | — | — | — | — | — | — | — | — |
| Result State | complete | complete | complete | complete | complete | complete | complete | complete | complete | complete |
| Measured Accuracy Score | — | — | — | — | — | — | — | — | — | — |
| Benchmark Version | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 | d0b1154 |
| Result Version | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 | 0.1.0 |
| Archive URI | gs://mlperf-endpoints-blob/runs/543bf208-1752-456a-9023-2b9def7fc888/archive.tar.gz | gs://mlperf-endpoints-blob/runs/ac882870-e1ae-4144-bbf1-0607920db278/archive.tar.gz | gs://mlperf-endpoints-blob/runs/b5fc9d3e-d626-4d35-ba82-ca3b016187a9/archive.tar.gz | gs://mlperf-endpoints-blob/runs/52394b12-bfe2-4413-90a3-5786bda92e14/archive.tar.gz | gs://mlperf-endpoints-blob/runs/934f515f-0f69-4583-89de-9bea66f01af1/archive.tar.gz | gs://mlperf-endpoints-blob/runs/46db041f-c562-4d54-9e02-64266005dcef/archive.tar.gz | gs://mlperf-endpoints-blob/runs/d9b32918-a093-4434-9c50-44f1dc5e41e0/archive.tar.gz | gs://mlperf-endpoints-blob/runs/45ea80ed-771f-4da4-98c3-cd4259354122/archive.tar.gz | gs://mlperf-endpoints-blob/runs/76e09625-871d-43d7-9a92-a50f4f523d96/archive.tar.gz | gs://mlperf-endpoints-blob/runs/6646e4e5-afd0-4442-a52c-fd2f2aa06315/archive.tar.gz |
| QPS | 1.1090 | 1.8750 | 2.7833 | 12.3678 | 20.9545 | 33.8391 | 51.5138 | 77.4180 | 103.9316 | 117.0239 |
| Total Output Tokens | 15,576,844 | 28,605,489 | 28,631,907 | 185,304,678 | 311,716,324 | 499,015,460 | 756,721,191 | 1,144,291,853 | 1,413,627,513 | 1,710,733,049 |
| Average Output Tokens | 3,622.52 | 3,763.88 | 3,767.36 | 3,774.03 | 3,760.15 | 3,771.85 | 3,751.72 | 3,754.24 | 3,743.72 | 3,774.79 |
| Run Duration (s) | 3,877.39 | 4,053.30 | 2,730.58 | 3,970.00 | 3,956.20 | 3,909.68 | 3,915.46 | 3,937.07 | 3,633.16 | 3,872.71 |
| Total Queries | 4,300 | 7,600 | 7,600 | 49,100 | 82,900 | 132,300 | 201,700 | 304,800 | 377,600 | 453,200 |
| Total Queries Issued | 4,300 | 7,600 | 7,600 | 49,100 | 82,900 | 132,300 | 201,700 | 304,800 | 377,600 | 453,200 |
| Total Queries Failed | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Time to First Token (TTFT) (ms) | ||||||||||
| Minimum | 139.7 | 146.1 | 150.9 | 157.1 | 170.7 | 168.3 | 200.2 | 200.5 | 199.5 | 176.3 |
| Average | 3175.9 | 199.6 | 225.9 | 680.9 | 616.1 | 584.0 | 621.6 | 1371.8 | 2997.1 | 1464.6 |
| P50 | 237.5 | 171.8 | 187.3 | 336.4 | 422.5 | 317.2 | 367.7 | 371.7 | 514.2 | 329.0 |
| P90 | 10113.4 | 262.4 | 297.0 | 1671.1 | 1207.5 | 1290.4 | 1044.7 | 3073.9 | 5298.7 | 404.0 |
| P95 | 14811.8 | 290.9 | 316.5 | 2262.0 | 1679.0 | 1680.2 | 1362.4 | 4347.9 | 14163.1 | 5770.4 |
| P99 | 24302.7 | 336.0 | 364.0 | 3427.9 | 3113.8 | 2900.3 | 6120.6 | 17842.8 | 45355.5 | 33413.1 |
| P999 | 35571.5 | 2438.4 | 2807.0 | 4534.3 | 4983.8 | 8406.9 | 15793.0 | 31734.1 | 63584.2 | 43135.4 |
| Maximum | 46355.1 | 2863.0 | 3151.8 | 5743.7 | 5004.9 | 9035.2 | 17665.4 | 34197.3 | 67197.3 | 44868.4 |
| Time Per Output Token (TPOT) (ms) | ||||||||||
| Minimum | 0.00 | 0.84 | 0.01 | 2.62 | 2.37 | 1.97 | 1.96 | 2.33 | 5.28 | 6.53 |
| Average | 3.18 | 4.52 | 4.54 | 5.35 | 6.36 | 7.88 | 10.4 | 13.6 | 19.4 | 34.8 |
| P50 | 3.14 | 4.47 | 4.49 | 5.30 | 6.30 | 7.81 | 10.4 | 13.6 | 19.6 | 35.6 |
| P90 | 3.59 | 4.98 | 5.01 | 5.92 | 7.04 | 8.75 | 11.6 | 15.2 | 20.6 | 38.2 |
| P95 | 3.67 | 5.09 | 5.10 | 6.04 | 7.18 | 8.92 | 11.9 | 15.5 | 20.8 | 38.8 |
| P99 | 3.82 | 5.25 | 5.27 | 6.26 | 7.43 | 9.23 | 12.3 | 16.1 | 21.2 | 39.7 |
| P999 | 4.00 | 5.48 | 5.50 | 6.50 | 7.73 | 9.61 | 12.8 | 16.8 | 21.6 | 40.6 |
| Maximum | 4.32 | 5.59 | 5.64 | 7.04 | 8.27 | 10.5 | 14.2 | 18.0 | 22.9 | 43.4 |
| Query Latency (ms) | ||||||||||
| Minimum | 793.5 | 1069.9 | 1001.2 | 1122.1 | 1196.4 | 1371.9 | 1494.0 | 1915.5 | 3176.8 | 4847.7 |
| Average | 14381.2 | 16772.1 | 16880.4 | 20351.1 | 23941.9 | 29547.8 | 38755.3 | 51260.0 | 74849.5 | 131201.6 |
| P50 | 10005.6 | 9561.1 | 9727.2 | 11929.7 | 13933.1 | 17172.4 | 22353.8 | 29909.6 | 44498.3 | 74738.7 |
| P90 | 32199.3 | 41480.4 | 41297.4 | 49578.2 | 58127.4 | 72564.0 | 96045.5 | 125891.4 | 182685.4 | 324380.7 |
| P95 | 45049.1 | 58435.7 | 58475.1 | 70747.7 | 82611.8 | 102971.4 | 135723.4 | 178905.9 | 257187.4 | 457239.2 |
| P99 | 61756.5 | 83988.3 | 82490.6 | 99282.5 | 117924.4 | 145864.1 | 193059.2 | 253234.2 | 376737.6 | 671764.0 |
| P999 | 72460.7 | 91330.7 | 90509.5 | 107746.4 | 128241.0 | 158353.6 | 209822.7 | 276608.7 | 392739.4 | 727381.0 |
| Maximum | 92203.2 | 97798.1 | 93067.2 | 120302.8 | 154702.5 | 182600.6 | 261548.6 | 360922.4 | 408893.9 | 754525.7 |