Skip to content

Commit d4a419b

Browse files
author
Ria Jain
committed
Added error handling
1 parent a3b4db2 commit d4a419b

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

components/backends/trtllm/src/dynamo/verifier/utils/api_drafter.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -90,6 +90,11 @@ async def get_draft_tokens(
9090

9191
draft_tokens = []
9292
try:
93+
if self.client is None:
94+
logging.error(
95+
f"Failed to create client for Dynamo endpoint: {self.endpoint}"
96+
)
97+
return []
9398
response = await self.client.round_robin(request_data)
9499
async for chunk in response:
95100
chunk_data = chunk.data()

0 commit comments

Comments
 (0)