Skip to content

Commit 80c186a

Browse files
mgoinshreyankg
authored andcommitted
[Bugfix][Example] Fix GCed profiling server for TPU (vllm-project#12792)
Signed-off-by: mgoin <michael@neuralmagic.com>
1 parent f1a5fb3 commit 80c186a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/offline_inference/profiling_tpu/profiling.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ def main(args: argparse.Namespace):
2424

2525
engine_args = EngineArgs.from_cli_args(args)
2626
llm = LLM(**dataclasses.asdict(engine_args))
27-
_ = xp.start_server(9012)
27+
server = xp.start_server(9012) # noqa: F841
2828

2929
sampling_params = SamplingParams(
3030
temperature=0.0,

0 commit comments

Comments
 (0)