Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deleting OVN networks fail in a clustered environment #709

Closed
panfantastic opened this issue Mar 31, 2024 · 4 comments · Fixed by #711
Closed

Deleting OVN networks fail in a clustered environment #709

panfantastic opened this issue Mar 31, 2024 · 4 comments · Fixed by #711
Assignees
Labels
Easy Good for new contributors
Milestone

Comments

@panfantastic
Copy link

Hi

I'm using 0.7.0 of Incus from the Zabbly apt repo alongside the microovn snap in a 3 node cluster environment.

The issue I'm seeing is that I cannot cleanly delete an OVN network. The general error message is of the form:

failed to notify peer 10.20.30.3:8443: Failed deleting OVS chassis "f11" from chassis group "incus-net28": object not found

The network is no longer listed in the northbound, but the incus database still has a listing for the network and can't be deleted without modifying the db manually.

@panfantastic
Copy link
Author

In a clean environment trying to create ovn networks and delete them...

root@f8:~# incus network create v1 network=uplink --type=ovn
Network v1 created
root@f8:~# microovn.ovn-nbctl show
switch cfe1a098-e60c-4d69-b3a6-e38cdb0dbb1f (incus-net29-ls-ext)
    port incus-net29-ls-ext-lsp-router
        type: router
        router-port: incus-net29-lr-lrp-ext
    port incus-net29-ls-ext-lsp-provider
        type: localnet
        addresses: ["unknown"]
switch 0cfe3bb6-0d0f-43e4-9d14-21c5bb6bd4c9 (incus-net29-ls-int)
    port incus-net29-ls-int-lsp-router
        type: router
        router-port: incus-net29-lr-lrp-int
router d2ccf537-4ff7-46fe-8aa0-54893555929d (incus-net29-lr)
    port incus-net29-lr-lrp-int
        mac: "00:16:3e:51:76:bd"
        networks: ["10.71.59.1/24", "fd42:8a8e:e5f:b546::1/64"]
    port incus-net29-lr-lrp-ext
        mac: "00:16:3e:51:76:bd"
        networks: ["10.20.30.51/24"]
    nat 84360452-8038-430e-a151-5066d1573a0c
        external ip: "10.20.30.51"
        logical ip: "10.71.59.0/24"
        type: "snat"
root@f8:~# incus network delete v1
Error: failed to notify peer 10.20.30.3:8443: Failed deleting OVS chassis "f11" from chassis group "incus-net29": object not found
root@f8:~# microovn.ovn-nbctl show
root@f8:~# 

@stgraber stgraber added Bug Easy Good for new contributors labels Apr 1, 2024
@stgraber stgraber self-assigned this Apr 1, 2024
@stgraber stgraber added this to the incus-6.0 milestone Apr 1, 2024
@stgraber
Copy link
Member

stgraber commented Apr 1, 2024

I've got that one reproduced locally, it didn't trip our testing due to automated testing only running on single-chassis deployments...

stgraber added a commit to stgraber/incus that referenced this issue Apr 1, 2024
This case happens when a network was deleted by the cluster leader but
some other servers in the cluster are yet to stop the network and remove
themselves as chassis in the HA group.

Closes lxc#709

Signed-off-by: Stéphane Graber <stgraber@stgraber.org>
@stgraber
Copy link
Member

stgraber commented Apr 1, 2024

The fix for this one is now in the zabbly stable repository.

@panfantastic
Copy link
Author

Thank you! I saw a short while ago that it was in zabbly stable and can confirm all is working as expected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Easy Good for new contributors
Development

Successfully merging a pull request may close this issue.

2 participants