Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Periodically Restart Executable Training Option #3280

Closed
GabHook opened this issue Jan 23, 2020 · 4 comments
Closed

Periodically Restart Executable Training Option #3280

GabHook opened this issue Jan 23, 2020 · 4 comments
Assignees
Labels
request Issue contains a feature request.

Comments

@GabHook
Copy link

GabHook commented Jan 23, 2020

Would be nice to have a command line training option for restarting the Unity executable after every steps.
We are not perfect and our executable currently runs out of memory after like 2 million steps. So it would be nice to have a fresh start of the executable after each steps so I could let the training go overnight without worrying it will crash.
Probably it wouldnt be hard to add either.

@GabHook GabHook added the request Issue contains a feature request. label Jan 23, 2020
@vincentpierre vincentpierre self-assigned this Jan 23, 2020
@vincentpierre
Copy link
Contributor

Thank you for your comments. We’ve documented your feedback and will prioritize when appropriate.

@vincentpierre
Copy link
Contributor

For reference, our internal tracking for the issue : MLA-558

@hvpeteet
Copy link
Contributor

While we have not added this feature, we do have a change on main allowing configurable restarts upon environment crashes. #5553. Not sure if this fulfills your need but it sounds like it may.

@github-actions
Copy link

github-actions bot commented Nov 4, 2022

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Nov 4, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
request Issue contains a feature request.
Projects
None yet
Development

No branches or pull requests

4 participants