Skip to content

Commit

Permalink
Pull model if not present locally (docker#119)
Browse files Browse the repository at this point in the history
Signed-off-by: denverdino <denverdino@gmail.com>
Signed-off-by: Joseph Villarreal Lopez <joseph.villarreal@66degrees.com>
  • Loading branch information
denverdino authored and Lapeyus committed Feb 19, 2024
1 parent b817c45 commit e1433d3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pull_model.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ COPY <<EOF pull_model.clj
(async/go-loop [n 0]
(let [[v _] (async/alts! [done (async/timeout 5000)])]
(if (= :stop v) :stopped (do (println (format "... pulling model (%ss) - will take several minutes" (* n 10))) (recur (inc n))))))
(process/shell {:env {"OLLAMA_HOST" url} :out :inherit :err :inherit} (format "./bin/ollama pull %s" llm))
(process/shell {:env {"OLLAMA_HOST" url} :out :inherit :err :inherit} (format "bash -c './bin/ollama show %s --modelfile > /dev/null || ./bin/ollama pull %s'" llm llm))
(async/>!! done :stop))
(println "OLLAMA model only pulled if both LLM and OLLAMA_BASE_URL are set and the LLM model is not gpt")))
Expand Down

0 comments on commit e1433d3

Please sign in to comment.