We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 2905d3c commit 6a31cd3Copy full SHA for 6a31cd3
benchmarks/backend_request_func.py
@@ -18,7 +18,7 @@
18
# NOTE(simon): do not import vLLM here so the benchmark script
19
# can run without vLLM installed.
20
21
-AIOHTTP_TIMEOUT = aiohttp.ClientTimeout(total=6 * 60 * 60)
+AIOHTTP_TIMEOUT = aiohttp.ClientTimeout(total=2 * 6 * 60 * 60)
22
23
24
@dataclass
0 commit comments