Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(sync-v2): Watchdog to detect stale syncing #857

Merged
merged 1 commit into from
Nov 9, 2023

Conversation

msbrogli
Copy link
Member

@msbrogli msbrogli commented Nov 9, 2023

Motivation

Sync-v2 might get stale if an unhandled exception occurs. Even though we want to learn about the issue to get it fixed, we also want the full node to recover from issues. So, this PR introduces a watchdog that closes the connection if the sync gets stale. The full node will automatically reconnect and try to sync again.

Acceptance Criteria

  1. Add a watchdog that detects if the syncing is stale.
  2. A sync is considered stale if a single loop has been running for more than 30 minutes.

Checklist

  • If you are requesting a merge into master, confirm this code is production-ready and can be included in future releases as soon as it gets merged

@msbrogli msbrogli requested a review from glevco November 9, 2023 16:10
@msbrogli msbrogli self-assigned this Nov 9, 2023
@msbrogli msbrogli requested a review from jansegre as a code owner November 9, 2023 16:10
@msbrogli msbrogli force-pushed the feat/sync-v2-watchdog branch 2 times, most recently from 02bd961 to 5e24bd2 Compare November 9, 2023 16:16
jansegre
jansegre previously approved these changes Nov 9, 2023
glevco
glevco previously approved these changes Nov 9, 2023
@msbrogli msbrogli dismissed stale reviews from glevco and jansegre via 4882dd4 November 9, 2023 16:41
@msbrogli msbrogli force-pushed the feat/sync-v2-watchdog branch from 5e24bd2 to 4882dd4 Compare November 9, 2023 16:41
@msbrogli msbrogli force-pushed the feat/sync-v2-watchdog branch from 4882dd4 to 45281a2 Compare November 9, 2023 17:06
@msbrogli msbrogli merged commit 45281a2 into master Nov 9, 2023
1 check passed
@msbrogli msbrogli deleted the feat/sync-v2-watchdog branch November 9, 2023 17:07
@jansegre jansegre mentioned this pull request Nov 13, 2023
2 tasks
This was referenced Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

3 participants