Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Project Limit Request: xFormers - 30 GiB #4168

Closed
3 tasks done
danthe3rd opened this issue Jun 6, 2024 · 1 comment
Closed
3 tasks done

Project Limit Request: xFormers - 30 GiB #4168

danthe3rd opened this issue Jun 6, 2024 · 1 comment
Assignees

Comments

@danthe3rd
Copy link

Project URL

https://pypi.org/project/xformers/

Does this project already exist?

  • Yes

New limit

30

Update issue title

  • I have updated the title.

Which indexes

PyPI

About the project

xFormers is a library used by machine-learning practitioners to speed-up their workloads. It contains specific and optimised low-level components.
It has been active for 3 years now, but gained a lot of exposure within the last few years - it's a critical project in Pypi, and has ~50k downloads per day.

We would like to be able to keep ~30 major releases on pypi - aka 30GB of storage.

(note: we were previously granted 20GB of storage #2907)

How large is each release?

Each binary is ~150MB (because we ship CUDA binaries for multiple GPU architectures), and each release contains 8 binaries ({win, linux} x {cp38, cp39, cp310, cp311}).
So each release is about 1GB

Binary size reduction: we're working on further reducing the binary size, but this effort depends on a modification to PyTorch which will make it to PyTorch 2.4, scheduled for September. The space limitation is currently a blocking issue that prevents further releases in the short term (unless we remove older binaries).

How frequently do you make a release?

Roughly every month, matching the PyTorch release schedule

Code of Conduct

  • I agree to follow the PSF Code of Conduct
@cmaureir
Copy link
Member

Hey @danthe3rd 👋
I've set the project limit for xFormers to 30 GB on PyPI.
Have a nice week 💯

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants