sglang/ GB200 perf

GB200 Nightly

585 runs 303 passed·280 failed·2 partial·new data 11 hours ago·sync 2 minutes ago

status: ok

Configs

· 7 tracked

dsr1-fp4-1k1k-low-latency

passed
no recent passed data
3 conc levelslatest 1 month ago

dsr1-fp4-1k1k-max-tpt

passed
no recent passed data
2 conc levelslatest 1 month ago

dsr1-fp4-1k1k-mid-curve

passed
4 conc levelslatest 11 hours ago

dsr1-fp4-8k1k-low-latency

passed
no recent passed data
2 conc levelslatest 1 month ago

dsr1-fp8-1k1k-low-latency

passed
no recent passed data
2 conc levelslatest 1 month ago

dsr1-fp8-1k1k-max-tpt

passed
4 conc levelslatest 12 hours ago

dsr1-fp8-1k1k-ultra-tpt

passed
1 conc levellatest 13 hours ago

Latest nightly

· cron

Latest nightly

11 hours ago·workflow #27927465630

fd7874dby bingxche

4/4 passed
dsr1-fp4-1k1k-mid-curve
conc 512·57,716tok/s +0.5%|conc 2048·179,078tok/s +1.3%|conc 4096·244,089tok/s +1.8%|conc 8192·214,206tok/s +0.8%
4/4 passed
dsr1-fp8-1k1k-max-tpt
conc 1024·72,644tok/s -0.3%|conc 2048·132,628tok/s -0.1%|conc 4096·215,371tok/s -0.2%|conc 6144·245,887tok/s -0.1%
1/1 passed
dsr1-fp8-1k1k-ultra-tpt
conc 4096·122,514tok/s +0.1%