Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Binder services running out of memory #4454

Closed
jnywong opened this issue Jul 19, 2024 · 2 comments
Closed

Binder services running out of memory #4454

jnywong opened this issue Jul 19, 2024 · 2 comments

Comments

@jnywong
Copy link
Member

jnywong commented Jul 19, 2024

Context

I keep running into OOM errors when trying to build this environment.yml.

I have tried building this environment some of our available binder services, e.g.

and run into the same error:

Step 39/50 : RUN TIMEFORMAT='time: %3R' bash -c 'time ${MAMBA_EXE} env update -p ${NB_PYTHON_PREFIX} --file "binder/environment.yml" && time ${MAMBA_EXE} clean --all -f -y && ${MAMBA_EXE} list -p ${NB_PYTHON_PREFIX} '
 ---> Running in 5ef5962be9b5
Channels:
 - conda-forge
 - defaults
Platform: linux-64
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... bash: line 1:     8 Killed                  ${MAMBA_EXE} env update -p ${NB_PYTHON_PREFIX} --file "binder/environment.yml"
time: 36.818
 ---> Removed intermediate container 5ef5962be9b5
The command '/bin/sh -c TIMEFORMAT='time: %3R' bash -c 'time ${MAMBA_EXE} env update -p ${NB_PYTHON_PREFIX} --file "binder/environment.yml" && time ${MAMBA_EXE} clean --all -f -y && ${MAMBA_EXE} list -p ${NB_PYTHON_PREFIX} '' returned a non-zero code: 137

I've also checked Grafana and I can see pods getting killed :(

Screenshot 2024-07-19 at 11 49 32

Proposal

No response

Updates and actions

No response

@sgibson91
Copy link
Member

I reverted PR #4416 to see if that unblocks you and reopened #4371 for further refinement

@yuvipanda
Copy link
Member

Closed as @sgibson91's revert fixed it! Thanks @sgibson91!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants