Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Forwarder vpp has memory leaks and it could fail in 48h by OOM in load #656

Closed
denis-tingaikin opened this issue Jun 6, 2022 · 1 comment
Labels
bug Something isn't working
Milestone

Comments

@denis-tingaikin
Copy link
Member

denis-tingaikin commented Jun 6, 2022

Foud on aws long ci testing

See at

                     "ready": true,
                        "restartCount": 2,
                        "image": "ghcr.io/networkservicemesh/ci/cmd-forwarder-vpp:836920c",
                        "imageID": "docker-pullable://ghcr.io/networkservicemesh/ci/cmd-forwarder-vpp@sha256:4a8d6cf9f9565a1897786c4737bd418524bd27d5e1f4e184f3be20d86ba3500a",
                        "containerID": "docker://f2bc9cf5045bc0b07dee25d58bf798980afc85f6b495111c84e8aa9cbf76f40a",
                        "started": true

Stes to reproduce

  1. run some of nsm example with a few clients
  2. keep it for a 2 days

actual: OOM
expected: everything is good

Solution

Run forwarder-vpp with mem profiler

@denis-tingaikin denis-tingaikin added this to the v1.5.0 milestone Jun 6, 2022
@denis-tingaikin denis-tingaikin added the bug Something isn't working label Jun 6, 2022
@denis-tingaikin
Copy link
Member Author

Fixed by networkservicemesh/sdk-kernel#496

@glazychev-art Thanks! It was a nice catch.

nsmbot pushed a commit that referenced this issue Nov 19, 2022
…k-vpp@main

PR link: networkservicemesh/sdk-vpp#656

Commit: 89baf2c
Author: Laszlo Kiraly
Date: 2022-11-19 19:14:53 +0100
Message:
  - Fix MTU adjustment in case of remote vlan mechanism (#656)
The MTU should be updated in connection context based on the host
interface MTU in vpp instead of the sub-interface MTU.

Related PR: networkservicemesh/cmd-nse-remote-vlan/pull/107

Signed-off-by: Laszlo Kiraly <laszlo.kiraly@est.tech>
Signed-off-by: NSMBot <nsmbot@networkservicmesh.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant