OPNET-320: Full dual-stack implementation in vSphere #41096

mkowalski · 2023-07-10T12:05:25Z

No description provided.

openshift-ci-robot · 2023-07-10T12:05:29Z

@mkowalski: This pull request references OPNET-320 which is a valid jira issue.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci · 2023-07-10T12:05:29Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

openshift-ci · 2023-07-10T12:06:22Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: mkowalski
Once this PR has been reviewed and has the lgtm label, please assign jcaamano for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

ci-operator/config/openshift/cluster-network-operator/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

mkowalski · 2023-07-10T12:06:38Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-07-28T14:23:14Z

Waiting for openshift/kubernetes#1645

mkowalski · 2023-08-03T08:10:00Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-03T08:10:06Z

/test build04-dry

mkowalski · 2023-08-03T09:51:41Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

Confusing because the error seems to be network-related but it can't be anything from this PR

 level=error msg=InstallerPodNetworkingDegraded: Pod "installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1" on node "ci-op-glg34mcb-84b46-2kbl8-master-1" observed degraded networking: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1_openshift-etcd_74ef075e-b27f-4b73-ab7f-7840c503326d_0(cd9a896b977e2e067472395b8c8f55ea0c9415d8b6445ee3b6dc1d96355c585d): error adding pod openshift-etcd_installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1 to CNI network "multus-cni-network": plugin type="multus" name="multus-cni-network" failed (add): [openshift-etcd/installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1/74ef075e-b27f-4b73-ab7f-7840c503326d:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[openshift-etcd/installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1 cd9a896b977e2e067472395b8c8f55ea0c9415d8b6445ee3b6dc1d96355c585d network default NAD default] [openshift-etcd/installer-8-ci-op-glg34mcb-84b46-2kbl8-master-1 cd9a896b977e2e067472395b8c8f55ea0c9415d8b6445ee3b6dc1d96355c585d network default NAD default] failed to configure pod interface: failed to add pod route 10.128.0.0/14 via 10.130.0.1: file exists

mkowalski · 2023-08-03T15:51:49Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

This is a valid failure unfortunately



:  [sig-network] [Feature:IPv6DualStack] should have ipv4 and ipv6  internal node ip [Suite:openshift/conformance/parallel] [Suite:k8s] expand_less
--
Run #0: Failed expand_less                           2s                                                                                                          {  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1} | Run #0: Failed expand_less                           2s                                                                                                          {  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1} | Run #0: Failed expand_less | 2s | {  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1}
Run #0: Failed expand_less                           2s                                                                                                          {  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1} | Run #0: Failed expand_less | 2s | {  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1}
Run #0: Failed expand_less | 2s
{  fail [test/e2e/network/dual_stack.go:68]: Expected     <int>: 1 to equal     <int>: 2 Error: exit with code 1 Ginkgo exit error 1: exit with code 1}

mkowalski · 2023-08-03T15:52:18Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-4.14-e2e-vsphere-ovn-dualstack

openshift-ci-robot · 2023-08-03T15:54:05Z

@mkowalski: job(s): pull-ci-openshift-cluster-network-operator-4.14-e2e-vsphere-ovn-dualstack either don't exist or were not found to be affected, and cannot be rehearsed

mkowalski · 2023-08-03T16:04:20Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-11T11:28:20Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-11T12:34:01Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-14T07:01:03Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack
/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-15T07:50:56Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

openshift-ci-robot · 2023-08-15T07:52:45Z

@mkowalski, pj-rehearse: unable prepare a candidate for rehearsal; rehearsals will not be run. This could be due to a branch that needs to be rebased. ERROR:

couldn't rebase repo client

mkowalski · 2023-08-15T07:56:47Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-17T07:40:52Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-17T09:04:30Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-17T10:49:21Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-21T10:17:10Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-21T10:17:34Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-21T12:13:31Z

Aug 21 10:44:02.744333 ci-op-4gcj1qgg-e84a7-gsp5q-master-0 kubenswrapper[4184]: I0821 10:44:02.742477    4184 flags.go:64] FLAG: --node-ip="192.168.100.46,fd65:a1a8:60ad:271c::51"

From journalctl of one of the nodes, this seems sane

Aug 21 10:43:53.431277 ci-op-4gcj1qgg-e84a7-gsp5q-master-0 resolv-prepender.sh[3455]: Error: initializing source docker://registry.apps.build01-us-west-2.vmc.ci.openshift.org/ci-op-4gcj1qgg/stable@sha256:e3e972ac8e423b829ed798885d4e9491eaeab899975a35802f2acc0daec11698: pinging container registry registry.apps.build01-us-west-2.vmc.ci.openshift.org: Get "https://registry.apps.build01-us-west-2.vmc.ci.openshift.org/v2/": dial tcp: lookup registry.apps.build01-us-west-2.vmc.ci.openshift.org on [fd65:a1a8:60ad:271c::1]:53: dial udp [fd65:a1a8:60ad:271c::1]:53: connect: network is unreachable

Lots of those, not sure if that's issue or not. Rather not because shortly after we can see

Aug 21 10:43:55.710311 ci-op-4gcj1qgg-e84a7-gsp5q-master-0 resolv-prepender.sh[1809]: NM resolv-prepender: Download of baremetal runtime cfg image completed

                        "message": "Multiple errors are preventing progress:\n* Cluster operators authentication, baremetal, cluster-autoscaler, config-operator, control-plane-machine-set, csi-snapshot-controller, dns, etcd, image-registry, ingress, insights, kube-apiserver, kube-controller-manager, kube-scheduler, kube-storage-version-migrator, machine-api, machine-approver, machine-config, marketplace, monitoring, network, node-tuning, openshift-apiserver, openshift-controller-manager, service-ca, storage are not available\n* Could not update imagestream \"openshift/driver-toolkit\" (601 of 858): resource may have been deleted\n* Could not update oauthclient \"console\" (543 of 858): the server does not recognize this resource, check extension API servers\n* Could not update role \"openshift-apiserver/prometheus-k8s\" (842 of 858): resource may have been deleted\n* Could not update role \"openshift-authentication/prometheus-k8s\" (743 of 858): resource may have been deleted\n* Could not update role \"openshift-console-operator/prometheus-k8s\" (781 of 858): resource may have been deleted\n* Could not update role \"openshift-console/prometheus-k8s\" (784 of 858): resource may have been deleted\n* Could not update role \"openshift-controller-manager/prometheus-k8s\" (850 of 858): resource may have been deleted\n* Could not update role \"openshift/copied-csv-viewer\" (665 of 858): resource may have been deleted\n* Could not update rolebinding \"openshift/cluster-samples-operator-openshift-edit\" (491 of 858): resource may have been deleted",

NAME                                       VERSION                                                    AVAILABLE   PROGRESSING   DEGRADED   SINCE   MESSAGE
authentication                                                                                                                                     
baremetal                                                                                                                                          
cloud-controller-manager                   4.14.0-0.ci.test-2023-08-21-102737-ci-op-4gcj1qgg-latest   True        False         False      34m     
cloud-credential                                                                                      True        False         False      40m     
cluster-autoscaler                                                                                                                                 
config-operator                                                                                                                                    
console                                                                                                                                            
control-plane-machine-set                                                                                                                          
csi-snapshot-controller                                                                                                                            
dns                                                                                                                                                
etcd                                                                                                                                               
image-registry                                                                                                                                     
ingress                                                                                                                                            
insights                                                                                                                                           
kube-apiserver                                                                                                                                     
kube-controller-manager                                                                                                                            
kube-scheduler                                                                                                                                     
kube-storage-version-migrator                                                                                                                      
machine-api                                                                                                                                        
machine-approver                                                                                                                                   
machine-config                                                                                                                                     
marketplace                                                                                                                                        
monitoring                                                                                                                                         
network                                                                                                                                            
node-tuning                                                                                                                                        
openshift-apiserver                                                                                                                                
openshift-controller-manager                                                                                                                       
openshift-samples                                                                                                                                  
operator-lifecycle-manager                                                                                                                         
operator-lifecycle-manager-catalog                                                                                                                 
operator-lifecycle-manager-packageserver                                                                                                           
service-ca                                                                                                                                         
storage

                    {
                        "lastTransitionTime": "2023-08-21T10:54:36Z",
                        "lastUpdateTime": "2023-08-21T10:54:36Z",
                        "message": "ReplicaSet \"network-operator-7cf65ccf9f\" has timed out progressing.",
                        "reason": "ProgressDeadlineExceeded",
                        "status": "False",
                        "type": "Progressing"
                    }

mkowalski · 2023-08-22T09:07:38Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-28T09:43:16Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack
/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

mkowalski · 2023-08-30T17:01:06Z

/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack
/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack

openshift-bot · 2023-11-01T15:20:31Z

Issues in openshift/release go stale after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 15d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

openshift-merge-robot · 2023-11-01T15:20:43Z

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-bot · 2023-11-23T03:42:29Z

Stale issue in openshift/release rot after 15d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 15d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

mkowalski · 2023-11-23T08:46:50Z

/remove-lifecycle rotten

openshift-bot · 2023-12-23T10:21:16Z

Issues in openshift/release go stale after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 15d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

mkowalski · 2024-01-03T12:45:01Z

/remove-lifecycle stale

openshift-bot · 2024-02-02T17:12:43Z

Issues in openshift/release go stale after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 15d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

mkowalski · 2024-02-02T21:13:15Z

/lifecycle frozen

openshift-ci · 2024-02-02T21:13:19Z

@mkowalski: The lifecycle/frozen label cannot be applied to Pull Requests.

In response to this:

/lifecycle frozen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-bot · 2024-02-17T23:40:14Z

Stale issue in openshift/release rot after 15d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 15d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

mkowalski · 2024-02-19T14:38:53Z

/lifecycle frozen

openshift-ci · 2024-02-19T14:38:59Z

@mkowalski: The lifecycle/frozen label cannot be applied to Pull Requests.

In response to this:

/lifecycle frozen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci · 2024-03-01T21:35:22Z

@mkowalski: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/rehearse/openshift/cluster-network-operator/release-4.14/e2e-vsphere-ovn-dualstack	2e19cd4df6e3f54b07c57cc330742f3f8962d6a4	link	unknown	`/pj-rehearse pull-ci-openshift-cluster-network-operator-release-4.14-e2e-vsphere-ovn-dualstack`
ci/rehearse/openshift/cluster-network-operator/master/e2e-vsphere-ovn-dualstack	18a0ebfffde2172e4e589de2b0d592ac8a0ec7ee	link	unknown	`/pj-rehearse pull-ci-openshift-cluster-network-operator-master-e2e-vsphere-ovn-dualstack`
ci/prow/stackrox-stackrox-stackrox-stackrox-check	`e7eb61c`	link	true	`/test stackrox-stackrox-stackrox-stackrox-check`
ci/prow/ci-operator-config	`e7eb61c`	link	true	`/test ci-operator-config`

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

openshift-bot · 2024-03-17T17:53:48Z

Rotten issues in openshift/release close after 15d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

openshift-ci · 2024-03-17T17:54:00Z

@openshift-bot: Closed this PR.

In response to this:

Rotten issues in openshift/release close after 15d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Jul 10, 2023

openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 10, 2023

mkowalski force-pushed the OPNET-320 branch from 5e97a5e to 2e19cd4 Compare August 15, 2023 07:55

openshift-ci bot requested review from JacobTanenbaum, dcbw and jcaamano October 2, 2023 12:29

openshift-ci bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Nov 1, 2023

openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Nov 1, 2023

openshift-ci bot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Nov 23, 2023

openshift-ci bot removed the lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. label Nov 23, 2023

openshift-ci bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 23, 2023

openshift-ci bot removed the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Jan 3, 2024

openshift-ci bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Feb 2, 2024

openshift-ci bot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Feb 17, 2024

openshift-ci bot closed this Mar 17, 2024

mkowalski mentioned this pull request Apr 3, 2024

OPNET-320: Full dual-stack implementation in vSphere #50557

Closed

OPNET-320: Full dual-stack implementation in vSphere #41096

OPNET-320: Full dual-stack implementation in vSphere #41096

Uh oh!

Conversation

mkowalski commented Jul 10, 2023

Uh oh!

openshift-ci-robot commented Jul 10, 2023 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci bot commented Jul 10, 2023

Uh oh!

openshift-ci bot commented Jul 10, 2023

Uh oh!

mkowalski commented Jul 10, 2023

Uh oh!

mkowalski commented Jul 28, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

openshift-ci-robot commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 3, 2023

Uh oh!

mkowalski commented Aug 11, 2023

Uh oh!

mkowalski commented Aug 11, 2023

Uh oh!

mkowalski commented Aug 14, 2023

Uh oh!

mkowalski commented Aug 15, 2023

Uh oh!

openshift-ci-robot commented Aug 15, 2023

Uh oh!

mkowalski commented Aug 15, 2023

Uh oh!

mkowalski commented Aug 17, 2023

Uh oh!

mkowalski commented Aug 17, 2023

Uh oh!

mkowalski commented Aug 17, 2023

Uh oh!

mkowalski commented Aug 21, 2023

Uh oh!

mkowalski commented Aug 21, 2023

Uh oh!

mkowalski commented Aug 21, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mkowalski commented Aug 22, 2023

Uh oh!

mkowalski commented Aug 28, 2023

Uh oh!

mkowalski commented Aug 30, 2023

Uh oh!

openshift-bot commented Nov 1, 2023

Uh oh!

openshift-merge-robot commented Nov 1, 2023

Uh oh!

openshift-bot commented Nov 23, 2023

Uh oh!

mkowalski commented Nov 23, 2023

Uh oh!

openshift-bot commented Dec 23, 2023

Uh oh!

mkowalski commented Jan 3, 2024

Uh oh!

openshift-bot commented Feb 2, 2024

Uh oh!

mkowalski commented Feb 2, 2024

Uh oh!

openshift-ci bot commented Feb 2, 2024

Uh oh!

openshift-ci-robot commented Jul 10, 2023 •

edited by openshift-ci bot

Loading

mkowalski commented Aug 21, 2023 •

edited

Loading