How to re-initlaize a custom accelerator inside the training loop ? #5884
Replies: 3 comments
-
The link you provided isn't working. Can you share the correct link? |
Beta Was this translation helpful? Give feedback.
-
I have updated the link. |
Beta Was this translation helpful? Give feedback.
-
Thanks. I didn't dive deep into the code but looks to me like you actually want use a Not sure if this helps. Would probably need more details. |
Beta Was this translation helpful? Give feedback.
-
In the code I use, there is a custom accelerator (DDPAccelerator) that loads an embedding similarity search model as a separate process. Now I need to re-initialize this similar method after certain training steps. In order to do this, I need to get access to the accelerator callback mentioned in this line.
Is this possible?
@williamFalcon
Beta Was this translation helpful? Give feedback.
All reactions