Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automatic force-termination of hanging sessions #603

Closed
achimnol opened this issue Jul 26, 2022 · 1 comment · Fixed by #670
Closed

Automatic force-termination of hanging sessions #603

achimnol opened this issue Jul 26, 2022 · 1 comment · Fixed by #670
Assignees
@rapsealk
Labels
comp:manager Related to Manager component
Milestone
22.09

Comments

@achimnol
Copy link
Member

Thanks to #412 (PR: #480), now we can determine how long time has passed after a session has entered PREPARING or TERMINATING status.

Let's add a periodic check to scan such sessions and automatically force-terminate (with concrete reason logs) them.
@achimnol achimnol added type:feature Add new features comp:manager Related to Manager component labels Jul 26, 2022
@achimnol achimnol added this to the 22.09 milestone Jul 26, 2022
@achimnol achimnol changed the title Automatic force-termination of hanging sessions and recycle of manager Automatic force-termination of hanging sessions Jul 26, 2022
@KangJuSeong KangJuSeong self-assigned this Aug 5, 2022
@rapsealk
Copy link
Member

@KangJuSeong Would you mind if I take this issue?

This was referenced Aug 22, 2022
Merged
Closed
@rapsealk rapsealk assigned rapsealk and unassigned KangJuSeong Aug 25, 2022
@achimnol achimnol removed the type:feature Add new features label Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rapsealk rapsealk

Labels
comp:manager Related to Manager component
Projects
None yet
Milestone
22.09
Development

Successfully merging a pull request may close this issue.

feat: Automate force-termination of hanging sessions lablup/backend.ai
3 participants
@achimnol @rapsealk @KangJuSeong