Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubeflow Jupyter notebook images are large because of all the extra Python libs; can we shrink to improve pull times? #568

Closed
inc0 opened this issue Apr 3, 2018 · 4 comments

Comments

@inc0
Copy link

inc0 commented Apr 3, 2018

And that's an issue for minikube for example. There are all sorts of things we can do to shrink them.
Couple examples:

  • make sure all compile artifacts are gone
  • cherry-pick required things with multi-stage builds
  • change base image to something lightweight
@willingc
Copy link
Contributor

willingc commented Apr 8, 2018

Images are large because there are a ton of dependencies and third party libraries beyond Jupyter notebook being added to the container image.

A minimal Jupyter notebook version is available from jupyter/docker-stacks repo.

Let's amend this issue title to more accurately reflect the actual issue (lots of installed libraries beyond Jupyter). Thanks!

cc/ @jlewi @inc0

@jlewi jlewi changed the title Jupyter images are huge Kubeflow Jupyter notebook images are large because of all the extra Python libs; can we shrink to improve pull times? Apr 8, 2018
@willingc
Copy link
Contributor

willingc commented Apr 9, 2018

Thanks @jlewi

@inc0
Copy link
Author

inc0 commented Apr 9, 2018

@willingc true, issue is on our side rather than jupyter. We create 2 conda envs ~5gig each. I made an attempt to shrink images a bit here #579

@ankushagarwal
Copy link
Contributor

Closing since #689 has been merged

yanniszark pushed a commit to arrikto/kubeflow that referenced this issue Feb 15, 2021
Signed-off-by: Ce Gao <gaoce@caicloud.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants