Project Limit Request: xformers - 30 GB

[danthe3rd]

Project URL

https://pypi.org/project/xformers/

Does this project already exist?

• Yes

New limit

30

Update issue title

• I have updated the title.

Which indexes

PyPI

About the project

xFormers is a library used by machine-learning practitioners to speed-up their workloads. It contains specific and optimised low-level components.
It has been active for 2 years now, but gained a lot of exposure within the last year - it's a critical project in Pypi, and has ~50k downloads per day.

We would like to be able to keep ~20 major releases on pypi, plus the 10 most recent nightly releases - aka 30GB of storage.

How large is each release?

Each binary is ~100MB (because we ship CUDA binaries for multiple GPU architectures), and each release contains 8 binaries ({win, linux} x {cp38, cp39, cp310, cp311}).
So each release is about 1GB

How frequently do you make a release?

Roughly every 2 months
(we also push nightly pre-releases, up to 10 - the newer ones replacing the older ones)

Code of Conduct

• I agree to follow the PSF Code of Conduct

[di]

I've set the total project size limit for xformers to 20 GB on PyPI. Happy to revisit again if/when you reach that limit.

[danthe3rd]

Hi,
We're hitting the limit again now (at ~20GB). Would it be possible to push to 30GB? We're also working to reduce the binary size by a large margin - but we would still need to store a few releases before that (this solution depends on another package).
I'm also happy to open a new issue if that's the way to do it.