Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Fix for fast/cold-boot: call db_migrator only after old config is loaded" #15464

Merged
merged 1 commit into from
Jun 16, 2023

Conversation

vaibhavhd
Copy link
Contributor

Reverts #14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591

@yxieca yxieca merged commit 9649a44 into sonic-net:master Jun 16, 2023
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jun 16, 2023
…g is loaded (sonic-net#14933)" (sonic-net#15464)

This reverts commit 02b1783.

Reverts sonic-net#14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202211: #15516

mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jun 16, 2023
…g is loaded (sonic-net#14933)" (sonic-net#15464)

This reverts commit 02b1783.

Reverts sonic-net#14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202205: #15517

mssonicbld pushed a commit that referenced this pull request Jun 17, 2023
…g is loaded (#14933)" (#15464)

This reverts commit 02b1783.

Reverts #14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202305: #15618

mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jun 24, 2023
…g is loaded (sonic-net#14933)" (sonic-net#15464)

This reverts commit 02b1783.

Reverts sonic-net#14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jun 29, 2023
…g is loaded (sonic-net#14933)" (sonic-net#15464)

This reverts commit 02b1783.

Reverts sonic-net#14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202012: #15653

mssonicbld pushed a commit that referenced this pull request Jun 29, 2023
…g is loaded (#14933)" (#15464)

This reverts commit 02b1783.

Reverts #14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
vaibhavhd added a commit to vaibhavhd/sonic-buildimage that referenced this pull request Jun 30, 2023
yxieca pushed a commit that referenced this pull request Jul 7, 2023
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jul 7, 2023
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Jul 7, 2023
mssonicbld added a commit that referenced this pull request Jul 7, 2023
mssonicbld added a commit that referenced this pull request Jul 7, 2023
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Aug 14, 2023
mssonicbld pushed a commit that referenced this pull request Aug 14, 2023
mssonicbld pushed a commit to mssonicbld/sonic-buildimage that referenced this pull request Aug 21, 2023
mssonicbld added a commit that referenced this pull request Aug 21, 2023
sonic-otn pushed a commit to sonic-otn/sonic-buildimage that referenced this pull request Sep 20, 2023
…g is loaded (sonic-net#14933)" (sonic-net#15464)

This reverts commit 02b1783.

Reverts sonic-net#14933

The earlier commit caused a race condition that particularly broke cross branch warm upgrade.

Issue happens when db_migrator is still migrating the DB and finalizer is checking DB for list of components to reconcile.

If migration is not complete, finalizer get an empty list to wait for. Due to this, finalizer concludes warmboot (deletes system wide warmboot flag) and cause all the services to do cold restart.

ADO: 24274591
sonic-otn pushed a commit to sonic-otn/sonic-buildimage that referenced this pull request Sep 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants