Skip to content
This repository was archived by the owner on Oct 6, 2025. It is now read-only.

Comments

add array of model support to compose provider commands#53

Merged
xenoscopic merged 1 commit intodocker:mainfrom
glours:compose-provider-model-array
May 13, 2025
Merged

add array of model support to compose provider commands#53
xenoscopic merged 1 commit intodocker:mainfrom
glours:compose-provider-model-array

Conversation

@glours
Copy link
Contributor

@glours glours commented May 13, 2025

Docker Model CLI can now support Compose configuration using one provider to declare all the models to pass to services at once using array like this:

  model_service:
   provider:
     type: model
     options:
       model:
         - ai/qwen2.5:latest
         - ai/smollm2:135M-Q2_K

We know check if the model is already downloaded before doing a pull.

If multiple models are passed the MODEL environment variable send to Compose will concat the model names using , like MODEL=ai/qwen2.5:latest,ai/smollm2:135M-Q2_K

Copy link
Contributor

@xenoscopic xenoscopic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! It'll need a rebase on main, but the conflicts should be fairly painless.

Signed-off-by: Guillaume Lours <705411+glours@users.noreply.github.com>
@glours glours force-pushed the compose-provider-model-array branch from 744477d to c2c1886 Compare May 13, 2025 15:36
@glours
Copy link
Contributor Author

glours commented May 13, 2025

@xenoscopic done! 😉

@xenoscopic xenoscopic merged commit a6bccaf into docker:main May 13, 2025
1 check passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants