Skip to content
Benchmark

server: multimodal - fix misreported prompt and num prompt tokens #1295

Sign in to view logs

server: multimodal - fix misreported prompt and num prompt tokens

server: multimodal - fix misreported prompt and num prompt tokens #1295

Run time

Learn about OS pricing on GitHub Actions
Job Run time
bench-server-baseline (phi-2, q4_0)
1s
bench-server-baseline (phi-2, q8_0)
1s
bench-server-baseline (phi-2, f16)
3m 34s
3m 36s