Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ARM64 support for both dask and dask operator docker images #919

Open
VanWolf29 opened this issue Nov 2, 2024 · 3 comments
Open

Add ARM64 support for both dask and dask operator docker images #919

VanWolf29 opened this issue Nov 2, 2024 · 3 comments

Comments

@VanWolf29
Copy link

Hello,

I've been trying to implement this in a Kubernetes cluster in AWS, but I prefer to use Graviton (ARM64) instances due to its benefits and optimal cost. However, I've noticed that there are not images supporting this architecture.

I could also volunteer for doing it (if possible) but I'd need a bit of orientation for the CI building the images.

Thanks!

@bstadlbauer
Copy link
Collaborator

@jacobtomlinson Please correct me if I'm wrong here, but images are built using chartpress (here) and chartpress should support ARM builds (jupyterhub/binderhub#1422) with using

chartpress \
    --builder docker-buildx \
    --platform linux/amd64 --platform linux/arm64 

The question would be more around whether we'd want to maintain another image. Happy to help testing here as I've got an ARM machine in case that's helpful.

@jacobtomlinson
Copy link
Member

Yep no issues from me to add the other build.

@ryanolee
Copy link

ryanolee commented Nov 19, 2024

There are some minor issues building on QEMU specifically @bstadlbauer @jacobtomlinson (Currently used in CI)
dask/dask-docker@f82d231

Mainly that builds will currently hang forever if you do not build on a native hardware without the changes from that commit. Beyond that can confirm arm64 docker image work as expected. (see: https://mamba.readthedocs.io/en/latest/user_guide/troubleshooting.html#hangs-during-install-in-qemu)

(Falls inline with dask/dask-docker#333)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants