dsr1-fp8-1k1k-ultra-tpt

concurrency 4,096 · 9 days ago

cron

passed

re-run

Commit

SHA0417951

[Bug Fix] Validate tokenizer-dependent features with skip_tokenizer_init (#27882)

rllin·9 days ago

PR #27882 · [Bug Fix] Validate tokenizer-dependent features with skip_tokenizer_init

Run

GitHub Actions27522040539-1

Slurm job5307

GPUs16·prefill 8 / decode 8

ISL / OSL1024 / 1024

Logscron/27522040539-1/1k1k/dsr1-fp8-1k1k-ultra-tpt/2026-06-15/5307/sa-bench_isl_1024_osl_1024/

Metrics

28 captured

best_of

1.00

burstiness

1.00

completed

40,960

duration

616

max_concurrency

4,096

mean_e2el_ms

59,468ms

mean_itl_ms

2,951ms

mean_tpot_ms

60.45ms

mean_ttft_ms

3,832ms

median_e2el_ms

58,012ms

median_itl_ms

3,066ms

median_tpot_ms

61.61ms

median_ttft_ms

1,097ms

num_prompts

40,960

output_throughput

61,307tok/s

p99_e2el_ms

97,964ms

p99_itl_ms

3,843ms

p99_tpot_ms

62.53ms

p99_ttft_ms

40,733ms

peak_output_tokens_per_s

73,119s

request_throughput

66.53tok/s

std_e2el_ms

8,976ms

std_itl_ms

523ms

std_tpot_ms

3.48ms

std_ttft_ms

8,356ms

total_input_tokens

37,769,666

total_output_tokens

37,742,239

total_token_throughput

122,659tok/s