Skip to content

Commit 10b2bf1

Browse files
author
Benjamin Merkel
committed
Log guided decoding details on DEBUG, not INFO.
Guided decoding json schema contains potentially sensitive user inputs. Do not log user inputs on INFO while ignoring `disable_log_requests=True`. Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
1 parent d20e261 commit 10b2bf1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/engine/async_llm_engine.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -545,7 +545,7 @@ async def build_guided_decoding_logits_processor_async(
545545
sampling_params = copy.copy(sampling_params)
546546
guided_decoding = sampling_params.guided_decoding
547547

548-
logger.info(
548+
logger.debug(
549549
"Building guided decoding logits processor. "
550550
"guided_decoding: %s%s", guided_decoding,
551551
f", reasoning_backend: {reasoning_backend}"

0 commit comments

Comments
 (0)