Skip to content

Commit 3e03e48

Browse files
daitran2k1sumitd2
authored andcommitted
[Bugfix] Fix E2EL mean and median stats (vllm-project#9984)
Signed-off-by: daitran2k1 <tranquangdai7a@gmail.com> Signed-off-by: Sumit Dubey <sumit.dubey2@ibm.com>
1 parent 78c0405 commit 3e03e48

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

benchmarks/benchmark_serving.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -406,9 +406,9 @@ def calculate_metrics(
406406
median_itl_ms=np.median(itls or 0) * 1000,
407407
percentiles_itl_ms=[(p, np.percentile(itls or 0, p) * 1000)
408408
for p in selected_percentiles],
409-
mean_e2el_ms=np.median(e2els or 0) * 1000,
409+
mean_e2el_ms=np.mean(e2els or 0) * 1000,
410410
std_e2el_ms=np.std(e2els or 0) * 1000,
411-
median_e2el_ms=np.mean(e2els or 0) * 1000,
411+
median_e2el_ms=np.median(e2els or 0) * 1000,
412412
percentiles_e2el_ms=[(p, np.percentile(e2els or 0, p) * 1000)
413413
for p in selected_percentiles],
414414
)

0 commit comments

Comments
 (0)