Skip to content
Back to pull request #6495

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #246

Sign in to view logs

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #246

Triggered via pull request April 4, 2024 23:30
@phymbertphymbert
synchronize #6495
Status Cancelled
Total duration 9m 5s
Artifacts –

bench.yml

on: pull_request_target
Matrix: bench-server-baseline
Fit to window
Zoom out
Zoom in

Annotations

4 errors
bench-server-baseline (phi-2, q8_0)
The run was canceled by @phymbert.
bench-server-baseline (phi-2, q4_0)
The run was canceled by @phymbert.
bench-server-baseline (phi-2, f16)
The run was canceled by @phymbert.
bench-server-baseline (phi-2, f16)
The operation was canceled.