Skip to content

Issues: NVIDIA/nim-deploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

13 Open 14 Closed
13 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

nvml error when deploying NIM to AWS sagemaker
#98 opened Oct 17, 2024 by nkumaraws
Deploying on Google Cloud run
#97 opened Oct 11, 2024 by jruokola
deploying nim on k8s. With this custom-value.yaml, 3.1 8b model can be deployed but 70b failed.
#92 opened Sep 25, 2024 by SarielMa
Issue with Pod Termination in InferenceService using nvcr.io/nim/meta/llama-3.1-8b-instruct:1.1.2 - No Terminate Signal Sent to Nim Server
#91 opened Sep 23, 2024 by test-1pro
1
The default command with persistance.enabled results in fail to deploy state with no automatic PV provisioner
#87 opened Sep 5, 2024 by kjw3
Switch git clone command to use https
#86 opened Sep 5, 2024 by kjw3
Submitting PR for DigitalOcean Kubernetes (DOKS)
#85 opened Sep 3, 2024 by bikram20
Variable name "NGC_CLI_API_KEY" needs to be updated
#82 opened Aug 31, 2024 by tfrantzen
1
Error to deploy llama-3.1-8b-instruct:1.1.1 using downloaded model repository with modelcar and kserve
#64 opened Aug 7, 2024 by xieshenzh
2
NIM_SERVED_MODEL_NAME does not work for certain models
#63 opened Aug 7, 2024 by xieshenzh
InvalidHeaderValue
#62 opened Aug 6, 2024 by nemerna
RuntimeError: CUDA error: no kernel image is available for execution on the device
#61 opened Aug 2, 2024 by JIA-HONG-CHU
download-to-cache fails, **repo file list has not been validated**
#51 opened Jul 25, 2024 by LaithZumot2
8
ProTip! Add no:assignee to see everything that’s not assigned.