File tree Expand file tree Collapse file tree 1 file changed +9
-9
lines changed Expand file tree Collapse file tree 1 file changed +9
-9
lines changed Original file line number Diff line number Diff line change @@ -1093,15 +1093,15 @@ async def encode(
10931093 for the request.
10941094
10951095 Details:
1096- - If the engine is not running, start the background loop,
1097- which iteratively invokes
1098- {meth}`~ vllm.engine.async_llm_engine.AsyncLLMEngine.engine_step`
1099- to process the waiting requests.
1100- - Add the request to the engine's `RequestTracker`.
1101- On the next background loop, this request will be sent to
1102- the underlying engine.
1103- Also, a corresponding `AsyncStream` will be created.
1104- - Wait for the request outputs from `AsyncStream` and yield them.
1096+ - If the engine is not running, start the background loop,
1097+ which iteratively invokes
1098+ [` vllm.engine.async_llm_engine.AsyncLLMEngine.engine_step`][]
1099+ to process the waiting requests.
1100+ - Add the request to the engine's `RequestTracker`.
1101+ On the next background loop, this request will be sent to
1102+ the underlying engine.
1103+ Also, a corresponding `AsyncStream` will be created.
1104+ - Wait for the request outputs from `AsyncStream` and yield them.
11051105
11061106 Example:
11071107 ```
You can’t perform that action at this time.
0 commit comments