Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add ovn_network_logging_parser support #1481

Merged
merged 14 commits into from
Jul 11, 2024
Merged

Conversation

okozachenko1203
Copy link
Member

@okozachenko1203 okozachenko1203 commented Jun 28, 2024

depends-on: #1541

Copy link

atmosphere-ci bot commented Jul 5, 2024

Build failed.
https://ci.atmosphere.dev/t/atmosphere/buildset/632bddf185df48c98f161216178f5064

✔️ atmosphere-buildset-registry SUCCESS in 2h 06m 16s
✔️ atmosphere-build-container-image-neutron SUCCESS in 13m 03s
atmosphere-linters FAILURE in 3m 46s
✔️ atmosphere-build-collection SUCCESS in 3m 02s
✔️ atmosphere-molecule-aio-keycloak SUCCESS in 21m 38s
atmosphere-molecule-aio-openvswitch FAILURE in 1h 50m 51s
✔️ atmosphere-molecule-aio-ovn SUCCESS in 1h 30m 24s (non-voting)
✔️ atmosphere-molecule-csi-local-path-provisioner SUCCESS in 7m 53s
✔️ atmosphere-molecule-csi-rbd SUCCESS in 19m 43s

Warning:
Failed to update check run atmosphere/check: 500 Server Error: Internal Server Error for url: https://api.github.com/repos/vexxhost/atmosphere/check-runs/27079840583

@okozachenko1203
Copy link
Member Author

/recheck

1 similar comment
@okozachenko1203
Copy link
Member Author

/recheck

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

https://logs.atmosphere.dev/81/1481/09b7adc574e7e3f21fe735c9e9e92eddc5a6c107/check/atmosphere-molecule-aio-openvswitch/79151b4/ubuntu-jammy/pod-logs/openstack/neutron-server-759fbd7c6c-r6fcs/neutron-server.txt

2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager [None req-1212b065-6b74-40fc-809a-455c2a1f14d8 0922cdc95594402284d2eb324c01e814 7dc4eb6b2a4f47b4b95b5995184b14fd - - default default] Error during notification for neutron.services.trunk.rpc.backend.ServerSideRpcBackend.process_event-452748 trunk, after_delete: neutron.api.rpc.handlers.resources_rpc.InvalidResourceTypeClass: Invalid resource type None
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager Traceback (most recent call last):
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py", line 189, in _notify_loop
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     callback.method(resource, event, trigger, payload=payload)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/services/trunk/rpc/backend.py", line 68, in process_event
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     method[event](context, payload)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_log/helpers.py", line 67, in wrapper
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     return method(*args, **kwargs)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/services/trunk/rpc/server.py", line 203, in trunk_deleted
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     self._resource_rpc.push(context, [trunk], events.DELETED)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 246, in push
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     self._push(context, resource_type, type_resources, event_type)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 250, in _push
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     _validate_resource_type(resource_type)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 52, in _validate_resource_type
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager     raise InvalidResourceTypeClass(resource_type=resource_type)
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager neutron.api.rpc.handlers.resources_rpc.InvalidResourceTypeClass: Invalid resource type None
2024-07-08 19:05:16.674 8 ERROR neutron_lib.callbacks.manager �[00m

I don't know if this is related but could be..

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

Interesting

2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers [None req-c0a3d928-c52f-4001-b55d-4d646a593791 - - - - - -] Mechanism driver openvswitch failed in bind_port: neutron_lib.exceptions.SubnetNotFound: Subnet 06354542-3fca-4ea4-ada1-b6f71fd6e745 could not be found.
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/plugins/ml2/managers.py", line 866, in _bind_port_level
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     driver.obj.bind_port(context)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/plugins/ml2/drivers/openvswitch/mech_driver/mech_openvswitch.py", line 133, in bind_port
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     super(OpenvswitchMechanismDriver, self).bind_port(context)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/plugins/ml2/drivers/mech_agent.py", line 104, in bind_port
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     subnets = self.get_subnets_from_fixed_ips(context)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/plugins/ml2/drivers/mech_agent.py", line 149, in get_subnets_from_fixed_ips
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     subnets.append(context._plugin.get_subnet(
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/db/api.py", line 223, in wrapped
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     return f_with_retry(*args, **kwargs,
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/db/api.py", line 137, in wrapped
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     with excutils.save_and_reraise_exception():
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     self.force_reraise()
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     raise self.value
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/db/api.py", line 135, in wrapped
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     return f(*args, **kwargs)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     with excutils.save_and_reraise_exception() as ectxt:
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     self.force_reraise()
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     raise self.value
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     return f(*args, **kwargs)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/db/api.py", line 183, in wrapped
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     with excutils.save_and_reraise_exception():
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     self.force_reraise()
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     raise self.value
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron_lib/db/api.py", line 181, in wrapped
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     return f(*dup_args, **dup_kwargs)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/db/db_base_plugin_v2.py", line 1194, in get_subnet
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     subnet_obj = self._get_subnet_object(context, id)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers   File "/var/lib/openstack/lib/python3.10/site-packages/neutron/db/db_base_plugin_common.py", line 282, in _get_subnet_object
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers     raise exceptions.SubnetNotFound(subnet_id=id)
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers neutron_lib.exceptions.SubnetNotFound: Subnet 06354542-3fca-4ea4-ada1-b6f71fd6e745 could not be found.
2024-07-08 18:54:24.150 10 ERROR neutron.plugins.ml2.managers �[00m

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

2024-07-08 18:59:54.949 59 ERROR neutron_lib.rpc [None req-f6f616d6-b4cf-448c-8a06-997f25888f62 - - - - - -] Timeout in RPC method logging-plugin.get_sg_log_info_for_port. Waiting for 13 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 09c557ed44b343539d3304c8b4ca8246�[00m
2024-07-08 18:59:54.950 59 WARNING neutron_lib.rpc [None req-f6f616d6-b4cf-448c-8a06-997f25888f62 - - - - - -] Increasing timeout for logging-plugin.get_sg_log_info_for_port calls to 600 seconds. Restart the agent to restore it to the default value.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 09c557ed44b343539d3304c8b4ca8246�[00m

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

2024-07-08 18:10:41.753 1 INFO neutron.api.extensions [None req-fed7604e-3ccf-4a7d-ae2f-cfea04fd742e - - - - - -] Extension logging not supported by any of loaded plugins�[00m

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

I wonder if it is this

https://bugs.launchpad.net/neutron/+bug/2062009

and if we need this commit

openstack/neutron@6170309

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

OVN seems to work fine other than that 1 failure that always happens, maybe lets try to bump the Neutron commit to use that fix?

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

/cherry-pick stable/2024.1

@vexxhost-bot
Copy link
Collaborator

@mnaser: once the present PR merges, I will cherry-pick it on top of stable/2024.1 in a new PR and assign it to you.

In response to this:

/cherry-pick stable/2024.1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

/cherry-pick stable/2023.2

@vexxhost-bot
Copy link
Collaborator

@mnaser: once the present PR merges, I will cherry-pick it on top of stable/2023.2 in a new PR and assign it to you.

In response to this:

/cherry-pick stable/2023.2

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

/cherry-pick stable/2023.1

@vexxhost-bot
Copy link
Collaborator

@mnaser: once the present PR merges, I will cherry-pick it on top of stable/2023.1 in a new PR and assign it to you.

In response to this:

/cherry-pick stable/2023.1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@mnaser
Copy link
Member

mnaser commented Jul 10, 2024

/cherry-pick stable/zed

@vexxhost-bot
Copy link
Collaborator

@mnaser: once the present PR merges, I will cherry-pick it on top of stable/zed in a new PR and assign it to you.

In response to this:

/cherry-pick stable/zed

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@mnaser mnaser added the gate label Jul 10, 2024
@atmosphere-ci atmosphere-ci bot merged commit df7761d into main Jul 11, 2024
7 checks passed
@atmosphere-ci atmosphere-ci bot deleted the add-ovn-log-parser branch July 11, 2024 01:48
@vexxhost-bot
Copy link
Collaborator

@mnaser: #1481 failed to apply on top of branch "stable/2023.1":

Applying: feat: add ovn_network_logging_parser support
.git/rebase-apply/patch:334: trailing whitespace.
 
.git/rebase-apply/patch:352: trailing whitespace.
 
.git/rebase-apply/patch:432: trailing whitespace.
 
.git/rebase-apply/patch:496: trailing whitespace.
 
.git/rebase-apply/patch:519: trailing whitespace.
 
warning: 5 lines add whitespace errors.
Using index info to reconstruct a base tree...
M	images/neutron/Dockerfile
M	roles/defaults/vars/main.yml
Falling back to patching base and 3-way merge...
Auto-merging roles/defaults/vars/main.yml
Auto-merging images/neutron/Dockerfile
CONFLICT (content): Merge conflict in images/neutron/Dockerfile
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 feat: add ovn_network_logging_parser support
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".

In response to this:

/cherry-pick stable/2023.1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@vexxhost-bot
Copy link
Collaborator

@mnaser: new issue created for failed cherrypick: #1557

In response to this:

/cherry-pick stable/2023.1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@vexxhost-bot
Copy link
Collaborator

@mnaser: #1481 failed to apply on top of branch "stable/zed":

Applying: feat: add ovn_network_logging_parser support
.git/rebase-apply/patch:334: trailing whitespace.
 
.git/rebase-apply/patch:352: trailing whitespace.
 
.git/rebase-apply/patch:432: trailing whitespace.
 
.git/rebase-apply/patch:496: trailing whitespace.
 
.git/rebase-apply/patch:519: trailing whitespace.
 
warning: 5 lines add whitespace errors.
Using index info to reconstruct a base tree...
M	images/neutron/Dockerfile
M	roles/defaults/vars/main.yml
Falling back to patching base and 3-way merge...
Auto-merging roles/defaults/vars/main.yml
Auto-merging images/neutron/Dockerfile
CONFLICT (content): Merge conflict in images/neutron/Dockerfile
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 feat: add ovn_network_logging_parser support
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".

In response to this:

/cherry-pick stable/zed

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@vexxhost-bot
Copy link
Collaborator

@mnaser: new issue created for failed cherrypick: #1559

In response to this:

/cherry-pick stable/zed

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@vexxhost-bot
Copy link
Collaborator

@mnaser: new pull request created: #1561

In response to this:

/cherry-pick stable/2024.1

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@vexxhost-bot
Copy link
Collaborator

@mnaser: new pull request created: #1563

In response to this:

/cherry-pick stable/2023.2

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

atmosphere-ci bot pushed a commit that referenced this pull request Jul 11, 2024
This is an automated cherry-pick of #1481
/assign mnaser
atmosphere-ci bot pushed a commit that referenced this pull request Jul 11, 2024
This is an automated cherry-pick of #1481
/assign mnaser
okozachenko1203 added a commit that referenced this pull request Jul 11, 2024
okozachenko1203 added a commit that referenced this pull request Jul 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants