Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is resume ckpt not resume logger solved? #128

Closed
vpeopleonatank opened this issue Apr 22, 2021 · 2 comments
Closed

Is resume ckpt not resume logger solved? #128

vpeopleonatank opened this issue Apr 22, 2021 · 2 comments

Comments

@vpeopleonatank
Copy link

I 've seen this PR on pytorch-lightning repo, is this problem solved? Lightning-AI/pytorch-lightning#5931

@ashleve
Copy link
Owner

ashleve commented Apr 22, 2021

@vpeopleonatank Hi,
I'm pretty sure the issue you linked has been already solved, hovewer it doesn't have anything to do with resuming logger when resuming training from checkpoint.

Resuming loggers on ckpt has never been in lightning before, but it will be added in the future, currently scheduled for release 1.4.
You can track a progress here: Lightning-AI/pytorch-lightning#6361

If you need to you can resume wandb logger state by yourself, by setting the id parameter:

python run.py trainer.resume_from_ckpt=path/to/ckpt/ logger=wandb logger.wandb.id=ujh18721

You can find the id in the link of the run you want to resume:
image

@vpeopleonatank
Copy link
Author

Thanks for clarification. 🤝

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants