Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

kernel log warning regarding usage of --physdev-out #3449

Closed
murali-reddy opened this issue Nov 12, 2018 · 11 comments
Closed

kernel log warning regarding usage of --physdev-out #3449

murali-reddy opened this issue Nov 12, 2018 · 11 comments
Assignees
Milestone

Comments

@murali-reddy
Copy link
Contributor

What you expected to happen?

Weave net started using physdev module in its weave-npc component to efficiently identify the traffic originating or destined to local pods refer #3344

-A WEAVE-NPC -m physdev --physdev-out vethwe-bridge -j ACCEPT
-A WEAVE-NPC-EGRESS -m physdev --physdev-in vethwe-bridge -j RETURN

Usage of this module should not have any effect on performance, regression in functionality etc.

What happened?

We see below error in /var/log/kern.log

Nov 12 14:00:49 weave-master kernel: [  526.420089] xt_physdev: using --physdev-out in the OUTPUT, FORWARD and POSTROUTING chains for non-bridged traffic is not supported anymore.

How to reproduce it?

Message in kernel log should come up as soon as 2.5.0 release istalled

Versions:

$ weave version
weave 2.5.0

$ docker version
$ uname -a
Linux weave-master 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"12", GitVersion:"v1.12.0", GitCommit:"0ed33881dc4355495f623c6f22e7dd0b7632b7c0", GitTreeState:"clean", BuildDate:"2018-09-27T17:05:32Z", GoVersion:"go1.10.4", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"12", GitVersion:"v1.12.2", GitCommit:"17c77c7898218073f14c8d573582e8d2313dc740", GitTreeState:"clean", BuildDate:"2018-10-24T06:43:59Z", GoVersion:"go1.10.4", Compiler:"gc", Platform:"linux/amd64"}

@philipmather
Copy link

Seeing the same thing, doesn't appear to cause an issue other than spaming the terminal although others report it causes performance issues (see https://www.redhat.com/archives/libvir-list/2013-January/msg01107.html).

Possible fix seems to be...

iptables -D WEAVE-NPC -m physdev --physdev-out vethwe-bridge -j ACCEPT
iptables -A WEAVE-NPC -m physdev --physdev-is-bridged --physdev-out vethwe-bridge -j ACCEPT

...I haven't tested significantly as I'm using a really small test env.

@murali-reddy murali-reddy added this to the 2.5.1 milestone Nov 14, 2018
@murali-reddy
Copy link
Contributor Author

thanks @philipmather for your suggestion. I tested out suggested change it does mute the log message.

Care to raise a PR please?

Note that for fix we dont need to delete the rule, as chains are flushed whenever weave-net pod is restarted.

@notmaxx
Copy link

notmaxx commented Nov 21, 2018

seeing the same on 2.5.0

@murali-reddy
Copy link
Contributor Author

Fixed in #3453, shall be part of 2.5.1

@notmaxx
Copy link

notmaxx commented Nov 22, 2018

@murali-reddy when do you plan to release 2.5.1 ?

@murali-reddy
Copy link
Contributor Author

Do not think there is any targeted date. Other than this, no issues reported for 2.5.0 release so far.

I did see kernel log pile up due to this issue. So from operations point of view if users are having any issues then perhaps make sense to do 2.5.1 release sooner.

@notmaxx
Copy link

notmaxx commented Nov 22, 2018

hi @murali-reddy would be great to have a build with fixed logs, i used 2.5.0 for a week on test env and in general it works well for me. I want to promote it but this log flood is concern. Is it possible to release 2.5.1 with fix or at least have some build?

thank you

@jjo
Copy link

jjo commented Jan 17, 2019

Appreciate an update re: 2.5.1 release with this fix, we're also getting impacted
by this (weave 2.5.0 deployed via kops-1.11 on several kubernetes-1.11.6 clusters)

@murali-reddy
Copy link
Contributor Author

there are some open PR's targeted for 2.5.1 we will do a release once merged.

@murali-reddy
Copy link
Contributor Author

@jjo
Copy link

jjo commented Jan 21, 2019

@notmaxx @jjo Please find the new release https://github.com/weaveworks/weave/releases/tag/v2.5.1

Thanks @murali-reddy !

jjo added a commit to jjo/kops that referenced this issue Jan 21, 2019
This release fixes kubernetes#6369 syslog flooding as reported at
weaveworks/weave#3449.

Release notes
https://github.com/weaveworks/weave/releases/tag/v2.5.1

Signed-off-by: JuanJo Ciarlante <juanjosec@gmail.com>
jjo added a commit to jjo/kops that referenced this issue Jan 21, 2019
This release fixes kubernetes#6369 syslog flooding as reported at
weaveworks/weave#3449.

Release notes
https://github.com/weaveworks/weave/releases/tag/v2.5.1

Signed-off-by: JuanJo Ciarlante <juanjosec@gmail.com>
jjo added a commit to jjo/kops that referenced this issue Feb 22, 2019
This release fixes kubernetes#6369 syslog flooding as reported at
weaveworks/weave#3449.

Release notes
https://github.com/weaveworks/weave/releases/tag/v2.5.1

Signed-off-by: JuanJo Ciarlante <juanjosec@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

4 participants