Skip to content

Commit

Permalink
Model: Fix override application
Browse files Browse the repository at this point in the history
None values weren't being excluded on initial load when dumping.

Signed-off-by: kingbri <bdashore3@proton.me>
  • Loading branch information
bdashore3 committed Sep 30, 2024
1 parent 126a444 commit f20857c
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions main.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,8 +69,8 @@ async def entrypoint_async():
# TODO: remove model_dump()
await model.load_model(
model_path.resolve(),
**config.model.model_dump(),
draft=config.draft_model.model_dump(),
**config.model.model_dump(exclude_none=True),
draft=config.draft_model.model_dump(exclude_none=True),
)

# Load loras after loading the model
Expand Down

0 comments on commit f20857c

Please sign in to comment.