Skip to content

Commit

Permalink
API: Fix model info reporting
Browse files Browse the repository at this point in the history
A deprecated preferences global var was being referenced.

Signed-off-by: kingbri <bdashore3@proton.me>
  • Loading branch information
bdashore3 committed Sep 17, 2024
1 parent 06a798d commit 26ad0ef
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions endpoints/core/utils/model.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,9 @@
from asyncio import CancelledError
from typing import Optional

from common import gen_logging, model
from common import model
from common.networking import get_generator_error, handle_request_disconnect
from common.tabby_config import config
from common.utils import unwrap
from endpoints.core.types.model import (
ModelCard,
Expand Down Expand Up @@ -77,7 +78,7 @@ def get_current_model():
model_card = ModelCard(
id=unwrap(model_params.pop("name", None), "unknown"),
parameters=ModelCardParameters.model_validate(model_params),
logging=gen_logging.PREFERENCES,
logging=config.logging,
)

if draft_model_params:
Expand Down

0 comments on commit 26ad0ef

Please sign in to comment.