Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support new base images #1890

Closed
wants to merge 9 commits into from
Closed

Support new base images #1890

wants to merge 9 commits into from

Conversation

8W9aG
Copy link
Contributor

@8W9aG 8W9aG commented Aug 20, 2024

  • Support patch versions of torch by not stripping the torch version to major/minor
  • Add new compatibility matrix for torch 2.4.0 and CUDA 12.4.x and cuDNN
  • Exclude torchaudio from pip installs like torchvision since the new base images should include the torchaudio package

This will introduce a race condition, since building the base images relies on this matrix, and until that is run these base images will be invalid, so it should be done in close connection to the generation of those base images.

8W9aG added 9 commits August 20, 2024 15:38
* Support base images based on torch patch
versions.
* Adds torch 2.4.0 compatibility in the matrix
* Add CuDNN to CUDA 12.4.x compatibility
* Use our torch audio from the cog base images
instead
* Do not forward cu118 et al version modifiers
* We never want to useCogBaseImage when generating
base images.
* Make sure the modifier is always stripped from
torch (we don’t need it anymore)
* Support major/minor versions of torch that
resolve to latest patch version
* Add the concept of a set Patch to version, that
allows logic to know whether the patch version is
explicitly set or not.
* Add the compatible versions of torchvision and
torchaudio to the base image python packages
* When rendering the base image name, resolve the
latest torch patch version if not supplied
* Add BaseImageConfigurations that conform to the
null CUDA
@8W9aG
Copy link
Contributor Author

8W9aG commented Aug 21, 2024

Will separate 43f0d66 into a separate PR.

#1892

@8W9aG
Copy link
Contributor Author

8W9aG commented Aug 21, 2024

Making 46375e3 into a separate PR.

#1893

@8W9aG
Copy link
Contributor Author

8W9aG commented Aug 21, 2024

Isolating the torch patch version support in #1894

@8W9aG 8W9aG closed this Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant