Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Guide for multi-host distributed training with KerasHub #1850

Open
mattdangerw opened this issue Sep 19, 2024 · 0 comments
Open

Guide for multi-host distributed training with KerasHub #1850

mattdangerw opened this issue Sep 19, 2024 · 0 comments
Assignees
@SamanehSaadat
Labels
team-created Issues created by Keras Hub team as part of development roadmap.

Comments

@mattdangerw
Copy link
Member

Following off #1689, we should make sure we have a guide/example somewhere on Keras.io that shows how to use the automatic sharding API.

One good model to showcase could be Llama 3.1, which gets quite large. We could show TPU model parallel training.
@mattdangerw mattdangerw mentioned this issue Sep 19, 2024
Open
@sachinprasadhs sachinprasadhs added the team-created Issues created by Keras Hub team as part of development roadmap. label Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@SamanehSaadat SamanehSaadat

Labels
team-created Issues created by Keras Hub team as part of development roadmap.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mattdangerw @SamanehSaadat @sachinprasadhs