dsr1-fp4-1k1k-mid-curve

concurrency 2,048 · 20 days ago

cron

passed

re-run

Commit

SHA3b7a258

[CPU] upgrade dependent torch ver to PT2.12 (#21456)

ZailiWang·20 days ago

PR #21456 · [CPU] upgrade dependent torch ver to PT2.12

Run

GitHub Actions26928315759-1

Slurm job5116

GPUs48·prefill 16 / decode 32

ISL / OSL1024 / 1024

Logscron/26928315759-1/1k1k/dsr1-fp4-1k1k-mid-curve/2026-06-04/5116/sa-bench_isl_1024_osl_1024/

Metrics

28 captured

best_of

1.00

burstiness

1.00

completed

20,480

duration

200

max_concurrency

2,048

mean_e2el_ms

19,268ms

mean_itl_ms

939ms

mean_tpot_ms

19.16ms

mean_ttft_ms

1,609ms

median_e2el_ms

18,949ms

median_itl_ms

975ms

median_tpot_ms

19.62ms

median_ttft_ms

794ms

num_prompts

20,480

output_throughput

94,649tok/s

p99_e2el_ms

29,790ms

p99_itl_ms

1,482ms

p99_tpot_ms

20.69ms

p99_ttft_ms

11,467ms

peak_output_tokens_per_s

114,642s

request_throughput

103tok/s

std_e2el_ms

2,583ms

std_itl_ms

190ms

std_tpot_ms

1.31ms

std_ttft_ms

2,396ms

total_input_tokens

18,880,692

total_output_tokens

18,888,974

total_token_throughput

189,256tok/s