Not all Pods are Terminating with Kubernetes and Kathara 3.7.3 #277

BMG-DYNAMIT · 2024-03-20T22:03:55Z

Operating System

Ubuntu 22.04

Kathará Version

3.7.3

Bug Description

Hi,

I am using the Python-API to create a Network Scenario.
I am using Kathara with Kubernetes and Megalos with Kathara version 3.7.3
I am using Flannel CNI.

If I create a scenario with and deploy the lab with the Python-API it works.

If I try to stop the scenario with Kathara.undeploy_lab it hangs up.

kubectl show that some pods stay in

Running

state.

I have to terminate the scenario with kathara wipe

Steps To Reproduce

deploy a scenario with the Python-API, Kubernetes and Kathara 3.7.3.

Undeploy the scenario with Kathara.undeploy_lab

Expected Behavior

Kathara.undeploy_lab should delete all kathara pods

Check Command Output

No response

The text was updated successfully, but these errors were encountered:

BMG-DYNAMIT · 2024-03-20T22:13:58Z

It seems, that this occurs only sometimes.

BMG-DYNAMIT · 2024-03-20T22:24:56Z

Also with The Kathara-CLI some pods do not terminate with kathara lclean

Skazza94 · 2024-03-21T10:52:15Z

Hi @BMG-DYNAMIT,
thanks for the issue.

Could you please enable debugging from the settings (using kathara settings and change the log level to DEBUG) and send here the resulting output? So I can proceed with further debugging.

Thanks,
Mariano.

BMG-DYNAMIT · 2024-03-21T14:15:11Z

Because the output was too long, here a smaller example using kathara lstart and Kathara-Labs/main-labs/application-level/load-balancer-random/kathara-lab_load-balancer-ws-rnd

Starting:

DEBUG    Called `drop_privileges`...
DEBUG    Reference count is 0.
DEBUG    Reference count is 0, exiting.
┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│                                              Starting Network Scenario                                               │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
DEBUG    Checking network scenario integrity...
DEBUG    Checking `client1` integrity...
DEBUG    `client1` interfaces are [(0, Interface(client1, 0, None))].
DEBUG    Checking `client2` integrity...
DEBUG    `client2` interfaces are [(0, Interface(client2, 0, None))].
DEBUG    Checking `ws_random` integrity...
DEBUG    `ws_random` interfaces are [(0, Interface(ws_random, 0, None)), (1, Interface(ws_random, 1, None))].
DEBUG    Checking `server1` integrity...
DEBUG    `server1` interfaces are [(0, Interface(server1, 0, None))].
DEBUG    Checking `server2` integrity...
DEBUG    `server2` interfaces are [(0, Interface(server2, 0, None))].
DEBUG    Checking `server3` integrity...
DEBUG    `server3` interfaces are [(0, Interface(server3, 0, None))].
┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Description: A lab showing the operation of a random web switch based on iptables                                    │
│ Version: 2.0                                                                                                         │
│ Author(s): L. Ariemma, T. Caiazzi, G. Di Battista, M. Rimondini                                                      │
│ Email: contact@kathara.org                                                                                           │
│ Website: http://www.kathara.org/                                                                                     │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
DEBUG    Checking network scenario integrity...
DEBUG    Checking `client1` integrity...
DEBUG    `client1` interfaces are [(0, Interface(client1, 0, None))].
DEBUG    Checking `client2` integrity...
DEBUG    `client2` interfaces are [(0, Interface(client2, 0, None))].
DEBUG    Checking `ws_random` integrity...
DEBUG    `ws_random` interfaces are [(0, Interface(ws_random, 0, None)), (1, Interface(ws_random, 1, None))].
DEBUG    Checking `server1` integrity...
DEBUG    `server1` interfaces are [(0, Interface(server1, 0, None))].
DEBUG    Checking `server2` integrity...
DEBUG    `server2` interfaces are [(0, Interface(server2, 0, None))].
DEBUG    Checking `server3` integrity...
DEBUG    `server3` interfaces are [(0, Interface(server3, 0, None))].
DEBUG    response body:
         {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"1tlgzbfbj9yqqt2qxezkq","uid":"6cb10bc0-1efa-4cd5-a58a
         -29c5b4ee0cd9","resourceVersion":"95431","creationTimestamp":"2024-03-21T14:11:35Z","labels":{"app":"kathara","
         kubernetes.io/metadata.name":"1tlgzbfbj9yqqt2qxezkq"},"managedFields":[{"manager":"OpenAPI-Generator","operatio
         n":"Update","apiVersion":"v1","time":"2024-03-21T14:11:35Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"
         f:labels":{".":{},"f:app":{},"f:kubernetes.io/metadata.name":{}}}}}]},"spec":{"finalizers":["kubernetes"]},"sta
         tus":{"phase":"Active"}}

DEBUG    Event: ADDED - Namespace: 1tlgzbfbj9yqqt2qxezkq
DEBUG    response body:
         {"kind":"NamespaceList","apiVersion":"v1","metadata":{"resourceVersion":"95433"},"items":[{"metadata":{"name":"
         1tlgzbfbj9yqqt2qxezkq","uid":"6cb10bc0-1efa-4cd5-a58a-29c5b4ee0cd9","resourceVersion":"95431","creationTimestam
         p":"2024-03-21T14:11:35Z","labels":{"app":"kathara","kubernetes.io/metadata.name":"1tlgzbfbj9yqqt2qxezkq"},"man
         agedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:35Z
         ","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:kubernetes.io/metadata.nam
         e":{}}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}}]}

DEBUG    response body:
         {"apiVersion":"k8s.cni.cncf.io/v1","items":[],"kind":"NetworkAttachmentDefinitionList","metadata":{"continue":"
         ","resourceVersion":"95433"}}

DEBUG    response body:
         {"apiVersion":"k8s.cni.cncf.io/v1","items":[],"kind":"NetworkAttachmentDefinitionList","metadata":{"continue":"
         ","resourceVersion":"95433"}}

DEBUG    response body:
         {"apiVersion":"k8s.cni.cncf.io/v1","kind":"NetworkAttachmentDefinition","metadata":{"creationTimestamp":"2024-0
         3-21T14:11:36Z","generation":1,"labels":{"app":"kathara","name":"A"},"managedFields":[{"apiVersion":"k8s.cni.cn
         cf.io/v1","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec
         ":{".":{},"f:config":{}}},"manager":"OpenAPI-Generator","operation":"Update","time":"2024-03-21T14:11:36Z"}],"n
         ame":"kathara-a","namespace":"1tlgzbfbj9yqqt2qxezkq","resourceVersion":"95434","uid":"ffb4a297-fa43-407f-850e-6
         cb7fad120a6"},"spec":{"config":"{\n                            \"cniVersion\": \"0.3.0\",\n
         \"name\": \"a\",\n                            \"type\": \"megalos\",\n                            \"suffix\":
         \"1tlgzb\",\n                            \"vxlanId\": 11098673\n                        }"}}

DEBUG    response body:
         {"apiVersion":"k8s.cni.cncf.io/v1","items":[],"kind":"NetworkAttachmentDefinitionList","metadata":{"continue":"
         ","resourceVersion":"95434"}}

DEBUG    response body:
         {"apiVersion":"k8s.cni.cncf.io/v1","kind":"NetworkAttachmentDefinition","metadata":{"creationTimestamp":"2024-0
         3-21T14:11:36Z","generation":1,"labels":{"app":"kathara","name":"B"},"managedFields":[{"apiVersion":"k8s.cni.cn
         cf.io/v1","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec
         ":{".":{},"f:config":{}}},"manager":"OpenAPI-Generator","operation":"Update","time":"2024-03-21T14:11:36Z"}],"n
         ame":"kathara-b","namespace":"1tlgzbfbj9yqqt2qxezkq","resourceVersion":"95435","uid":"a88047d6-f198-480e-a196-6
         814d550ac3e"},"spec":{"config":"{\n                            \"cniVersion\": \"0.3.0\",\n
         \"name\": \"b\",\n                            \"type\": \"megalos\",\n                            \"suffix\":
         \"1tlgzb\",\n                            \"vxlanId\": 4121754\n                        }"}}

[Deploying collision domains]   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2/2
DEBUG    Creating device `client1`...
DEBUG    Creating device `client2`...
DEBUG    Creating device `ws_random`...
DEBUG    Creating device `server1`...
DEBUG    Creating device `server2`...
DEBUG    Creating device `server3`...
DEBUG    is_binary: '/tmp/tmpbd9fqml8__tartemp__/hostlab/client1.startup'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpxr72oi_3__tartemp__/hostlab/client2.startup'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpo61ji_cq__tartemp__/hostlab/ws_random.startup'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpuo_4h2p2__tartemp__/hostlab/server1/var/www/html/index.html'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpqhjd2q2k__tartemp__/hostlab/server3/var/www/html/index.html'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpdw25pg_b__tartemp__/hostlab/server2/var/www/html/index.html'
DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-client1-1tlgzbfbj9yqqt2qxezkq-files","namespa
         ce":"1tlgzbfbj9yqqt2qxezkq","uid":"f4607c7f-da65-4a83-b885-bf268b61d403","resourceVersion":"95436","creationTim
         estamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion
         ":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab.b64":{}}}}
         ]},"data":{"hostlab.b64":"H4sIABhA/GUC/+3V0QrCIBTGca97Cp9gndN0Pk6sNlgwWkzroqfPRd0MgoLWRfx/XhwVL8QPtRti6uvd2ixIs
         hD8VDV4vY+zZ7331fkQxImUeV7V5+XWmx84x1SPeStxuxv66+t14zAk83+6R/77/tAekxbTaaTz6ev5V5V7nb+rZvk7X4mxQv6LO5xs3TRjG+NU
         rYoUU1NZb5xt2ottUycrgz81u/+L/AOfv/+llo73HwAAAAAAAAAAAAAA4B03BZrBRgAoAAA="}}

DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-client2-1tlgzbfbj9yqqt2qxezkq-files","namespa
         ce":"1tlgzbfbj9yqqt2qxezkq","uid":"41ae0d41-481c-4402-8d94-bfac69ecf2ae","resourceVersion":"95438","creationTim
         estamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion
         ":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab.b64":{}}}}
         ]},"data":{"hostlab.b64":"H4sIABhA/GUC/+3VwQrCIBzHcc89hU9Q/pvOx4mtDRaMNqZ16Olzoy6DQUHrML4fD38VD+IPtelCbIvyoFZkE
         u/dWMU7mcbJu059sc57Y43J0ryIS8u1U39wC7EY0lbCqezax/K6oeui2p7mlf+5vdTXeNyPpxFv/c/zz3O7nL/NZ/lbl4vShvxXd+l1UVVDHcJY
         tRizH5vI4Wh1Vd91HRuzU9io2f1f5R/4/v3PJOP9BwAAAAAAAAAAAAAA+MgTAKHi2QAoAAA="}}

DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-ws-random-96a209a2-1tlgzbfbj9yqqt2qxezkq-file
         s","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"72610a95-8cdb-41ea-95dc-16ec83d61444","resourceVersion":"95437","
         creationTimestamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update",
         "apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab
         .b64":{}}}}]},"data":{"hostlab.b64":"H4sIABhA/GUC/+3W3UrDMBQH8F7vKc4LdEvaph3eCYp4M2XM65G2wVa6JjSZMp/etCrKZDjBio
         z/rxf5OiWHntK00tY1Mp8FI2Jelom+5Zngw9h7b4c+T0SWsYSx2M9zLnw4ieAPbK2TnU/FrnPdPB+O67R2wemp3ur/ZNedbEu9mfbPw23NL9c/T
         ZND9ecszfbqLyKeBsRQ/9HVhmRZdsraviXO2LS/olmUUKkeSbmKTb4EDTHiUwyf+CAn80bZsFH3sthRGA5jaqXzfWmMaku6XV4ub+5W14srP1cq
         62q/XOv2Y2MKDbnC9MtGd47mzHc30hUV+Uq52t9S9DO6VPT6xvqR6XQu87qp3Y7YNI791MN2Y+hicb7qE9F7ew1b8bM5+0dZi6OSjsZO+vsUYp9
         CACf6/R/hT+Dn538s0hTnPwAAAAAAAAAAAAAAAAAAwLFeAMdYUKUAKAAA"}}

DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpuo_4h2p2__tartemp__/hostlab/server1.startup'
DEBUG    nontext_ratio1: 0.0
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    is_binary: '/tmp/tmpqhjd2q2k__tartemp__/hostlab/server3.startup'
DEBUG    nontext_ratio1: 0.0
DEBUG    is_binary: '/tmp/tmpdw25pg_b__tartemp__/hostlab/server2.startup'
DEBUG    nontext_ratio2: 1.0
DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    nontext_ratio1: 0.0
DEBUG    failure: decodable_as_unicode: False
DEBUG    nontext_ratio2: 1.0
DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-ws-random-96a209a2","namespace":"1tlgzb
         fbj9yqqt2qxezkq","uid":"2717e3a6-cbf4-4cc0-84e6-5c59630365e4","resourceVersion":"95442","generation":1,"creatio
         nTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"ws_random"},"managedFields":[{"manager":"O
         penAPI-Generator","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"Field
         sV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds
         ":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:max
         Surge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni
         .cncf.io/networks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{
         "f:containers":{"k:{\"name\":\"kathara-ws-random-96a209a2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_S
         HELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postSt
         art":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:pri
         vileged":{}},"f:stdin":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMou
         nts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kat
         hara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f
         :hostname":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds
         ":{},"f:volumes":{".":{},"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{
         }},"f:name":{}},"k:{\"name\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}
         }}}]},"spec":{"replicas":1,"selector":{"matchLabels":{"app":"kathara","name":"ws_random"}},"template":{"metadat
         a":{"creationTimestamp":null,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"ws_random"},"anno
         tations":{"k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\": \"net0\"}, {\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net1\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-ws-random-96a209a2-1tlgzbfbj9yq
         qt2qxezkq-files","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCrea
         te"}}],"containers":[{"name":"kathara-ws-random-96a209a2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL
         ","value":"/bin/bash"}],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"s
         hared","mountPath":"/shared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f
         \"/tmp/post_start\" ]; then exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0;
         sysctl -w -q net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/ws_random\" ];
         then (cd /hostlab/ws_random \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/ws_random.startup\" ]; then chmod u+x
         /hostlab/ws_random.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/ws_random.startup;
         /hostlab/ws_random.startup \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :;
         touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-ws-random-96a209a2",
         "schedulerName":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpda
         te","rollingUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSecon
         ds":600},"status":{}}

DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-client1","namespace":"1tlgzbfbj9yqqt2qx
         ezkq","uid":"326185e0-40f7-4267-a355-3f19c033b36d","resourceVersion":"95439","generation":1,"creationTimestamp"
         :"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"client1"},"managedFields":[{"manager":"OpenAPI-Genera
         tor","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV
         1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:repli
         cas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:
         maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/netw
         orks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:containers
         ":{"k:{\"name\":\"kathara-client1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name
         ":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{"
         .":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{
         },"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mount
         Path\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:moun
         tPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:hostname":{},"f:restart
         Policy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{}
         ,"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"na
         me\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}}}}]},"spec":{"replicas"
         :1,"selector":{"matchLabels":{"app":"kathara","name":"client1"}},"template":{"metadata":{"creationTimestamp":nu
         ll,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"client1"},"annotations":{"k8s.v1.cni.cncf.i
         o/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-client1-1tlgzbfbj9yqqt2qxezkq-f
         iles","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}],"con
         tainers":[{"name":"kathara-client1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}
         ],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/s
         hared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then
         exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client1\" ]; then
         (cd /hostlab/client1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client1.startup\" ]; then chmod u+x
         /hostlab/client1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client1.startup; /hostlab/client1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-client1","schedulerN
         ame":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpdate","rollin
         gUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"s
         tatus":{}}

DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-client2","namespace":"1tlgzbfbj9yqqt2qx
         ezkq","uid":"0e4212b7-ee76-493e-a51e-2de826ab12be","resourceVersion":"95441","generation":1,"creationTimestamp"
         :"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"client2"},"managedFields":[{"manager":"OpenAPI-Genera
         tor","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV
         1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:repli
         cas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:
         maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/netw
         orks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:containers
         ":{"k:{\"name\":\"kathara-client2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name
         ":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{"
         .":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{
         },"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mount
         Path\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:moun
         tPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:hostname":{},"f:restart
         Policy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{}
         ,"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"na
         me\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}}}}]},"spec":{"replicas"
         :1,"selector":{"matchLabels":{"app":"kathara","name":"client2"}},"template":{"metadata":{"creationTimestamp":nu
         ll,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"client2"},"annotations":{"k8s.v1.cni.cncf.i
         o/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-client2-1tlgzbfbj9yqqt2qxezkq-f
         iles","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}],"con
         tainers":[{"name":"kathara-client2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}
         ],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/s
         hared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then
         exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client2\" ]; then
         (cd /hostlab/client2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client2.startup\" ]; then chmod u+x
         /hostlab/client2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client2.startup; /hostlab/client2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-client2","schedulerN
         ame":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpdate","rollin
         gUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"s
         tatus":{}}

DEBUG    is_likely_binary: False
DEBUG    detected_encoding: {'encoding': 'ascii', 'confidence': 1.0, 'language': ''}
DEBUG    failure: decodable_as_unicode: False
DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-server1-1tlgzbfbj9yqqt2qxezkq-files","namespa
         ce":"1tlgzbfbj9yqqt2qxezkq","uid":"665df30b-5015-4931-ad48-8d984321a4d2","resourceVersion":"95479","creationTim
         estamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion
         ":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab.b64":{}}}}
         ]},"data":{"hostlab.b64":"H4sIABhA/GUC/+2Wy26jMBRAs/ZX3K6YWdSPBIcNyld0iURJcEUkMka2k0xG/fgxpoSETjdVU9rRPVHihy4G3
         2McV9q6uliz2Q3hniSRbSkSKULb05ehLmKZJDzmfOH7hZA+HOTsE9hbVxj/KDZf6/rP23FGazf7/6he/FtlDsoI9jX8L8QyRv8T+KdtNty++XD/
         Sy/0Lf9Cjv3HS+79c/R/c7YNFGVplLVtCYLT9iPYPIZSHUC5ihMfY/TeqRBRqqdiXzs4bIs+Wg6hxJ6sU7uNqyGsJCiaYlOpOZkh32L/PxTmw/8
         D3rH/JxL3/8n8H49HNq1/v/9z9D+l/8rtajaZfyljfP+n97/9VarftK3e8vwnBBcj/4lczPH89xmkrd0VSde6PK0Ieai2Foxq6hNs9E5ZeDJ6B9
         3iAHFHSNoYtSIwIs/zcR/z32zU+Qyg/e84NGvDycVYgZ/wo6+S4fpXnEeL7gM0NGjXiMa3eoZ/3P89nSy77hzmHSbNcsiuMjE08pesZBCFZ6VR9
         /h9o89EFqYUnQfuGuc8dfFX0IvpRjS/9EOvM/EYhTzR++jxlcvswsVwAUlZMO/LbqmkrFs5eIRGEARBEARBEARBEARBEAT5kvwF/AU4cAAoAAA=
         "}}

DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-server3-1tlgzbfbj9yqqt2qxezkq-files","namespa
         ce":"1tlgzbfbj9yqqt2qxezkq","uid":"a5911e92-7859-476b-ade3-1f9301f2c4cc","resourceVersion":"95480","creationTim
         estamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion
         ":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab.b64":{}}}}
         ]},"data":{"hostlab.b64":"H4sIABhA/GUC/+2WTY+bMBCGc+ZXTHshlQiGgOGCcum1Ui899IAEJHhFJFIjTJKm4sfXNkkXs7uXarP0Yx4Um
         div7RneiUPFRVcXW7K4I54kjqlq/Zj6+rvk1up7P6Rx7IWeF8h+36dSDnTxBhxFV7QyFJFtef3jZV3Lebf496iu/gvWnlgbkD/D/8CPIvR/Bv9d
         9TS6Y/Pq/kdR+KL/Pp36H0ae9N9D/+/OvoGiLFsmhGrB91x1BWQdQslOwLrKs6Sm5ceOaUXJHopj3cFpX9zU9FFqiYvo2GHX1aArCYqm2FVsbS2
         Qv+L8PxXtq/8H/Mb5H1M8/2fz/3w+k3n9l+f/Gv2f0/+qO9RkNv8pDfH3P7//+28l++6q23u+//lBOPU/pqGP739vQaLc3VjJlpeXjfWl2gtoWV
         NfYMcPTMBDyw8w1AYE76ykadkGTJzVauWCZXS5tuwCSI3upbwc+71iMiF3vo6+mGMkh3wsdbPx8NLYVn0yY9N+Eqdj88kGjwoCXMes+GDEkMqMR
         ru5mcQxU077YWaqx+zrtJHEzu30trokc65Ca7yNCvIW7TNrqAg+DsP2aJahgHylpro2jHO0Jqb1Rubu5yeSLOsBRvHKeDJTQiD/9MsS0DnbT8y7
         BuQqSW7rpygNko4a9uti0fpUhSUXkZWSTlLLiFZmetUUep3m8vYIEqJK05LtUMkJGQob3/ARBEEQBEEQBEEQBEEQBPlf+QnvyJcOACgAAA=="}}

DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-server1","namespace":"1tlgzbfbj9yqqt2qx
         ezkq","uid":"7a969b65-a259-4eba-90f5-96aa50b0ebe3","resourceVersion":"95481","generation":1,"creationTimestamp"
         :"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server1"},"managedFields":[{"manager":"OpenAPI-Genera
         tor","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV
         1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:repli
         cas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:
         maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/netw
         orks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:containers
         ":{"k:{\"name\":\"kathara-server1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name
         ":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{"
         .":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{
         },"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mount
         Path\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:moun
         tPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:hostname":{},"f:restart
         Policy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{}
         ,"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"na
         me\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}}}}]},"spec":{"replicas"
         :1,"selector":{"matchLabels":{"app":"kathara","name":"server1"}},"template":{"metadata":{"creationTimestamp":nu
         ll,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"server1"},"annotations":{"k8s.v1.cni.cncf.i
         o/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-server1-1tlgzbfbj9yqqt2qxezkq-f
         iles","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}],"con
         tainers":[{"name":"kathara-server1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}
         ],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/s
         hared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then
         exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server1\" ]; then
         (cd /hostlab/server1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server1.startup\" ]; then chmod u+x
         /hostlab/server1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server1.startup; /hostlab/server1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-server1","schedulerN
         ame":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpdate","rollin
         gUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"s
         tatus":{}}

DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-server3","namespace":"1tlgzbfbj9yqqt2qx
         ezkq","uid":"a4871d48-26c4-4acd-9f0f-f5b460e85792","resourceVersion":"95483","generation":1,"creationTimestamp"
         :"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server3"},"managedFields":[{"manager":"OpenAPI-Genera
         tor","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV
         1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:repli
         cas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:
         maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/netw
         orks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:containers
         ":{"k:{\"name\":\"kathara-server3\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name
         ":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{"
         .":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{
         },"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mount
         Path\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:moun
         tPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:hostname":{},"f:restart
         Policy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{}
         ,"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"na
         me\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}}}}]},"spec":{"replicas"
         :1,"selector":{"matchLabels":{"app":"kathara","name":"server3"}},"template":{"metadata":{"creationTimestamp":nu
         ll,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"server3"},"annotations":{"k8s.v1.cni.cncf.i
         o/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-server3-1tlgzbfbj9yqqt2qxezkq-f
         iles","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}],"con
         tainers":[{"name":"kathara-server3","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}
         ],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/s
         hared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then
         exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server3\" ]; then
         (cd /hostlab/server3 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server3.startup\" ]; then chmod u+x
         /hostlab/server3.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server3.startup; /hostlab/server3.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-server3","schedulerN
         ame":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpdate","rollin
         gUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"s
         tatus":{}}

DEBUG    response body:
         {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"kathara-server2-1tlgzbfbj9yqqt2qxezkq-files","namespa
         ce":"1tlgzbfbj9yqqt2qxezkq","uid":"52f4668c-c261-4b9c-99b4-00eeec4c2039","resourceVersion":"95507","creationTim
         estamp":"2024-03-21T14:11:36Z","managedFields":[{"manager":"OpenAPI-Generator","operation":"Update","apiVersion
         ":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:hostlab.b64":{}}}}
         ]},"data":{"hostlab.b64":"H4sIABhA/GUC/+2Xz4+iMBTHPfeveHvbw8ZShsoF507ikezFGILSGZzgQAB13TT7t+9rwfltJkxG2Z28TxML9
         X3T137bWrOibvJkyUdnxEF8X5pa+FLYd+RY22fhSd93PMe5wnYhJIaDHF2Abd0kFaZSx8si/306riqKZvT1yDr/a1XtVOXyf8P/KzEh/4fwf2xm
         o9mWn+7/ZOKd9F/Il/57Ewf9d8j/s7MuIUnTStW1qUE4Y1Nc7nqQqh2oJnMYxlTFtlE2IlU3yTZvYLdOjtHyMZTVh7pRm1WTg11JkJTJKlMuGxH
         /xfm/S6pP/w34wPnvSzr/B/N/v9/zYf3H81+Q/0P6nzWbnA/mv5Qe7f/h/V/fp+rX2Dye8/4nJF72n/uPx7+g+98lCIy71yxYFunhmrEoW9dQqT
         I/wKrYqBpuqmID7eIA9xsLykphGCDxBzDCCKZ9AR0ZpYY/vdHzWSvtn+xcW2WI0un0SfuzoZuZgDHAjzHEpgbTFLVKPY/vAGZx2JWXLwBc859af
         7/lGl9wnJBbZR6+l26Xw5NUwoV1Bft86OKtsgAbYOuuRT8IT6pmAGFrOX6+ITzdHw4YzPeL+CiMcGLe7zF+TNGm3M5ZJ+zGEL6aFmyZYfxrjsLe
         tMK8/+q5Y4wFvN0uAW+3V8Db3UZ/OwiCIAiCIAiCIAiCIAiCuAB/AaBN3XYAKAAA"}}

DEBUG    response body:
         {"kind":"Deployment","apiVersion":"apps/v1","metadata":{"name":"kathara-server2","namespace":"1tlgzbfbj9yqqt2qx
         ezkq","uid":"55b0fa77-a873-47c4-aa04-4cb15935b416","resourceVersion":"95508","generation":1,"creationTimestamp"
         :"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server2"},"managedFields":[{"manager":"OpenAPI-Genera
         tor","operation":"Update","apiVersion":"apps/v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV
         1":{"f:metadata":{"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:repli
         cas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:
         maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/netw
         orks":{}},"f:deletionGracePeriodSeconds":{},"f:labels":{".":{},"f:app":{},"f:name":{}}},"f:spec":{"f:containers
         ":{"k:{\"name\":\"kathara-server2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name
         ":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{"
         .":{},"f:command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{
         },"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mount
         Path\":\"/shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:moun
         tPath":{},"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:hostname":{},"f:restart
         Policy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{}
         ,"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"na
         me\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}}}}]},"spec":{"replicas"
         :1,"selector":{"matchLabels":{"app":"kathara","name":"server2"}},"template":{"metadata":{"creationTimestamp":nu
         ll,"deletionGracePeriodSeconds":0,"labels":{"app":"kathara","name":"server2"},"annotations":{"k8s.v1.cni.cncf.i
         o/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"}},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-server2-1tlgzbfbj9yqqt2qxezkq-f
         iles","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}],"con
         tainers":[{"name":"kathara-server2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}
         ],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/s
         hared"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then
         exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server2\" ]; then
         (cd /hostlab/server2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server2.startup\" ]; then chmod u+x
         /hostlab/server2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server2.startup; /hostlab/server2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","securityContext":{},"hostname":"kathara-server2","schedulerN
         ame":"default-scheduler","dnsConfig":{"nameservers":["127.0.0.1"]}}},"strategy":{"type":"RollingUpdate","rollin
         gUpdate":{"maxUnavailable":"25%","maxSurge":"25%"}},"revisionHistoryLimit":10,"progressDeadlineSeconds":600},"s
         tatus":{}}

DEBUG    Event: ADDED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: ADDED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: ADDED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: ADDED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: ADDED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: ADDED - Pod: kathara-ws-random-96a209a2-57fc58b887-hxxcs (Device ws_random)
DEBUG    Event: MODIFIED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: MODIFIED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: MODIFIED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: MODIFIED - Pod: kathara-ws-random-96a209a2-57fc58b887-hxxcs (Device ws_random)
DEBUG    Event: MODIFIED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: MODIFIED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: MODIFIED - Pod: kathara-ws-random-96a209a2-57fc58b887-hxxcs (Device ws_random)
DEBUG    Device `ws_random` ready.
DEBUG    Event: MODIFIED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Device `client2` ready.
DEBUG    Event: MODIFIED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Device `client1` ready.
DEBUG    Event: MODIFIED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Device `server1` ready.
DEBUG    Event: MODIFIED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Device `server3` ready.
DEBUG    Event: MODIFIED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Device `server2` ready.

And if I try to Stop it with kathara lclean:

kathara-ws-random-96a209a2-57fc58b887-hxxcs is still running and kathara lclean is stuck

1tlgzbfbj9yqqt2qxezkq   kathara-client1-5464f8f866-72n2p              1/1     Terminating   0          57s
1tlgzbfbj9yqqt2qxezkq   kathara-client2-5d78db459d-f4k8f              1/1     Terminating   0          57s
1tlgzbfbj9yqqt2qxezkq   kathara-server1-8b7897787-bg7bj               1/1     Terminating   0          57s
1tlgzbfbj9yqqt2qxezkq   kathara-server2-59fb79f9f9-bxt7k              1/1     Terminating   0          57s
1tlgzbfbj9yqqt2qxezkq   kathara-server3-7557bbf76c-hx7cc              1/1     Terminating   0          57s
1tlgzbfbj9yqqt2qxezkq   kathara-ws-random-96a209a2-57fc58b887-hxxcs   1/1     Running       0          57s
kube-flannel            kube-flannel-ds-58rfw                         1/1     Running       0          14h
kube-flannel            kube-flannel-ds-7thnr                         1/1     Running       0          14h
kube-flannel            kube-flannel-ds-qcghx                         1/1     Running       0          14h
kube-flannel            kube-flannel-ds-qqbfc                         1/1     Running       0          14h
kube-system             coredns-5dd5756b68-68l4q                      1/1     Running       0          14h
kube-system             coredns-5dd5756b68-dfq9n                      1/1     Running       0          14h
kube-system             etcd-i72tb18-6g                               1/1     Running       8          14h
kube-system             kube-apiserver-i72tb18-6g                     1/1     Running       8          14h
kube-system             kube-controller-manager-i72tb18-6g            1/1     Running       13         14h
kube-system             kube-kathara-control-plane-655f5dcdfb-hnlnt   1/1     Running       0          14h
kube-system             kube-kathara-worker-ds-gr5rb                  1/1     Running       0          14h
kube-system             kube-kathara-worker-ds-k5fqf                  1/1     Running       0          14h
kube-system             kube-kathara-worker-ds-npsvz                  1/1     Running       0          14h
kube-system             kube-multus-ds-46hm6                          1/1     Running       0          14h
kube-system             kube-multus-ds-stpxs                          1/1     Running       0          14h
kube-system             kube-multus-ds-vqqjp                          1/1     Running       0          14h
kube-system             kube-multus-ds-wqqs8                          1/1     Running       0          14h
kube-system             kube-proxy-4r84w                              1/1     Running       0          14h
kube-system             kube-proxy-8fkxd                              1/1     Running       0          14h
kube-system             kube-proxy-rz9pn                              1/1     Running       0          14h
kube-system             kube-proxy-sh5fx                              1/1     Running       0          14h
kube-system             kube-scheduler-i72tb18-6g                     1/1     Running       13         14h
kube-system             metrics-server-98bc7f888-t6m6j                1/1     Running       0          14h

DEBUG    Called `drop_privileges`...
DEBUG    Reference count is 0.
DEBUG    Reference count is 0, exiting.
DEBUG    Checking network scenario integrity...
DEBUG    Checking `client1` integrity...
DEBUG    `client1` interfaces are [(0, Interface(client1, 0, None))].
DEBUG    Checking `client2` integrity...
DEBUG    `client2` interfaces are [(0, Interface(client2, 0, None))].
DEBUG    Checking `ws_random` integrity...
DEBUG    `ws_random` interfaces are [(0, Interface(ws_random, 0, None)), (1, Interface(ws_random, 1, None))].
DEBUG    Checking `server1` integrity...
DEBUG    `server1` interfaces are [(0, Interface(server1, 0, None))].
DEBUG    Checking `server2` integrity...
DEBUG    `server2` interfaces are [(0, Interface(server2, 0, None))].
DEBUG    Checking `server3` integrity...
DEBUG    `server3` interfaces are [(0, Interface(server3, 0, None))].
┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│                                              Stopping Network Scenario                                               │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-client1-5464f8f866-72n2p","generateName":"kathara-client1-5464f8f866-","namespace":"1tlgzbfbj9yqqt2qxezkq","u
         id":"fc7530a5-d0fb-49a9-8894-b7b37d9074ec","resourceVersion":"95568","creationTimestamp":"2024-03-21T14:11:36Z"
         ,"labels":{"app":"kathara","name":"client1","pod-template-hash":"5464f8f866"},"annotations":{"k8s.v1.cni.cncf.i
         o/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.16.218\"\n    ],\n    \"mac\": \"b6:c0:6f:08:fa:ac\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.16.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-a\",\n
         \"interface\": \"net0\",\n    \"mac\": \"16:b9:02:54:8b:78\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-client1-5464f8f866"
         ,"uid":"b1b06383-8a91-4f93-a8b5-67701b0f260f","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"b1b06383-8a91-4f93-a8b5-67701b0f260f\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-clien
         t1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.16.218\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"vol
         umes":[{"name":"hostlab","configMap":{"name":"kathara-client1-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},
         {"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-fgwph"
         ,"projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name"
         :"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","
         fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":
         "kathara-client1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"
         volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"k
         ube-api-access-fgwph","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle"
         :{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client1\" ]; then
         (cd /hostlab/client1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client1.startup\" ]; then chmod u+x
         /hostlab/client1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client1.startup; /hostlab/client1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb19-6g","securityContext":{},"hostname":"kathara-client1","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:37Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:37Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.2","podIP":"10.244.16.218","podIPs":[{"ip":"10.244.16.218"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-client1","state":{"running":{"startedAt":
         "2024-03-21T14:11:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://b36ce34e97f6e3d53a90a310d16f3d446b162a7ba7ab61350731104eada701ab","started":true}],"qosC
         lass":"BestEffort"}},{"metadata":{"name":"kathara-client2-5d78db459d-f4k8f","generateName":"kathara-client2-5d7
         8db459d-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"e11f71a0-0f24-4403-8a97-0c3fe00ebb5b","resourceVersion":"9
         5561","creationTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"client2","pod-template-hash"
         :"5d78db459d"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n    \"name\": \"cbr0\",\n
         \"interface\": \"eth0\",\n    \"ips\": [\n        \"10.244.48.90\"\n    ],\n    \"mac\":
         \"3e:e2:84:ea:2b:93\",\n    \"default\": true,\n    \"dns\": {},\n    \"gateway\": [\n        \"10.244.48.1\"\n
         ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-a\",\n    \"interface\": \"net0\",\n    \"mac\":
         \"56:07:1f:62:fa:82\",\n    \"dns\": {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\",
         \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-client2-5d78db459d"
         ,"uid":"fc640049-f58d-4a25-ae80-359b92ccce92","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"fc640049-f58d-4a25-ae80-359b92ccce92\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-clien
         t2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.48.90\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-client2-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-c4xbx",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-client2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-c4xbx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client2\" ]; then
         (cd /hostlab/client2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client2.startup\" ]; then chmod u+x
         /hostlab/client2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client2.startup; /hostlab/client2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb21-6g","securityContext":{},"hostname":"kathara-client2","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:37Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:37Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.4","podIP":"10.244.48.90","podIPs":[{"ip":"10.244.48.90"}],"star
         tTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-client2","state":{"running":{"startedAt":"2
         024-03-21T14:11:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","im
         ageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","contai
         nerID":"containerd://9f075399c17eec5c212b026f2b9b4184ae90d016a9fec7782225aa0d98ab1ed2","started":true}],"qosCla
         ss":"BestEffort"}},{"metadata":{"name":"kathara-server1-8b7897787-bg7bj","generateName":"kathara-server1-8b7897
         787-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"e2c1cea1-979c-41ef-af9e-966ee4dc44c2","resourceVersion":"95576
         ","creationTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server1","pod-template-hash":"8b
         7897787"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\":
         \"eth0\",\n    \"ips\": [\n        \"10.244.47.202\"\n    ],\n    \"mac\": \"86:a1:ed:3b:22:f3\",\n
         \"default\": true,\n    \"dns\": {},\n    \"gateway\": [\n        \"10.244.32.1\"\n    ]\n},{\n    \"name\":
         \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n    \"interface\": \"net0\",\n    \"mac\": \"a6:9a:47:67:ab:48\",\n
         \"dns\": {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\", \"namespace\":
         \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server1-8b7897787",
         "uid":"b9f18821-04b9-478f-9d61-c2baa256f7ea","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"m
         anager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsT
         ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:genera
         teName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{
         \"uid\":\"b9f18821-04b9-478f-9d61-c2baa256f7ea\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-server
         1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{}
         ,"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name"
         :{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{},
         "f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f:
         mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dns
         Config":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolicy
         ":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\
         "name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":\
         "shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon","
         operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:meta
         data":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubelet
         ","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:41Z","fieldsType":"FieldsV1","fieldsV1":{"f:s
         tatus":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":
         {},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime
         ":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{}
         ,"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{
         },"k:{\"ip\":\"10.244.47.202\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-server1-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-f4xnd",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-server1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-f4xnd","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server1\" ]; then
         (cd /hostlab/server1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server1.startup\" ]; then chmod u+x
         /hostlab/server1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server1.startup; /hostlab/server1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb20-6g","securityContext":{},"hostname":"kathara-server1","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:41Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:41Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.3","podIP":"10.244.47.202","podIPs":[{"ip":"10.244.47.202"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server1","state":{"running":{"startedAt":
         "2024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://e2545917be5c539a40a00182c70ad87aa663dd0778d949927f992c149b6fd31b","started":true}],"qosC
         lass":"BestEffort"}},{"metadata":{"name":"kathara-server2-59fb79f9f9-bxt7k","generateName":"kathara-server2-59f
         b79f9f9-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"6cb7bb08-39ae-48d2-a40d-9cd2da67e361","resourceVersion":"9
         5582","creationTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server2","pod-template-hash"
         :"59fb79f9f9"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n    \"name\": \"cbr0\",\n
         \"interface\": \"eth0\",\n    \"ips\": [\n        \"10.244.48.92\"\n    ],\n    \"mac\":
         \"2a:4e:4c:5f:ee:4f\",\n    \"default\": true,\n    \"dns\": {},\n    \"gateway\": [\n        \"10.244.48.1\"\n
         ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n    \"interface\": \"net0\",\n    \"mac\":
         \"82:69:eb:ce:e1:48\",\n    \"dns\": {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\",
         \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server2-59fb79f9f9"
         ,"uid":"6e01ade8-1c66-4ea1-bab3-b1c7cc54f4dd","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"6e01ade8-1c66-4ea1-bab3-b1c7cc54f4dd\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-serve
         r2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:42Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.48.92\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-server2-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-j4stj",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-server2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-j4stj","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server2\" ]; then
         (cd /hostlab/server2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server2.startup\" ]; then chmod u+x
         /hostlab/server2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server2.startup; /hostlab/server2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb21-6g","securityContext":{},"hostname":"kathara-server2","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:42Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:42Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.4","podIP":"10.244.48.92","podIPs":[{"ip":"10.244.48.92"}],"star
         tTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server2","state":{"running":{"startedAt":"2
         024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","im
         ageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","contai
         nerID":"containerd://f198011648fa938a7dbc7ea82012fffa9d2290ab8463f3674df4e5a58cea7332","started":true}],"qosCla
         ss":"BestEffort"}},{"metadata":{"name":"kathara-server3-7557bbf76c-hx7cc","generateName":"kathara-server3-7557b
         bf76c-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"2194cc6b-ac6e-49cb-a8ba-c41cacf7d8fa","resourceVersion":"955
         78","creationTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"server3","pod-template-hash":"
         7557bbf76c"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n    \"name\": \"cbr0\",\n
         \"interface\": \"eth0\",\n    \"ips\": [\n        \"10.244.47.203\"\n    ],\n    \"mac\":
         \"42:5c:e8:30:0e:38\",\n    \"default\": true,\n    \"dns\": {},\n    \"gateway\": [\n        \"10.244.32.1\"\n
         ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n    \"interface\": \"net0\",\n    \"mac\":
         \"2a:c7:21:28:19:da\",\n    \"dns\": {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\",
         \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server3-7557bbf76c"
         ,"uid":"89f98a3d-4871-4358-b98c-fcd63a681baa","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"89f98a3d-4871-4358-b98c-fcd63a681baa\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-serve
         r3\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:41Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.47.203\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"vol
         umes":[{"name":"hostlab","configMap":{"name":"kathara-server3-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},
         {"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-7kk8p"
         ,"projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name"
         :"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","
         fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":
         "kathara-server3","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"
         volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"k
         ube-api-access-7kk8p","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle"
         :{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server3\" ]; then
         (cd /hostlab/server3 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server3.startup\" ]; then chmod u+x
         /hostlab/server3.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server3.startup; /hostlab/server3.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb20-6g","securityContext":{},"hostname":"kathara-server3","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:41Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:41Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.3","podIP":"10.244.47.203","podIPs":[{"ip":"10.244.47.203"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server3","state":{"running":{"startedAt":
         "2024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://a153cd735bb9f049d635acb7d2b2af50bf7886332c1f9afca8ed7931ed526511","started":true}],"qosC
         lass":"BestEffort"}},{"metadata":{"name":"kathara-ws-random-96a209a2-57fc58b887-hxxcs","generateName":"kathara-
         ws-random-96a209a2-57fc58b887-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid":"72ce69a3-797a-401c-9cdd-29b9e955f694
         ","resourceVersion":"95559","creationTimestamp":"2024-03-21T14:11:36Z","labels":{"app":"kathara","name":"ws_ran
         dom","pod-template-hash":"57fc58b887"},"annotations":{"k8s.v1.cni.cncf.io/network-status":"[{\n    \"name\":
         \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n        \"10.244.48.91\"\n    ],\n    \"mac\":
         \"8a:38:71:45:53:4a\",\n    \"default\": true,\n    \"dns\": {},\n    \"gateway\": [\n        \"10.244.48.1\"\n
         ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-a\",\n    \"interface\": \"net0\",\n    \"mac\":
         \"ae:47:6a:12:1e:8d\",\n    \"dns\": {}\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n
         \"interface\": \"net1\",\n    \"mac\": \"3e:fd:54:d2:8f:85\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\": \"net0\"}, {\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\", \"interface\":
         \"net1\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-ws-random-96a209a2-
         57fc58b887","uid":"b3f73740-2595-4276-a65c-18c78c348d08","controller":true,"blockOwnerDeletion":true}],"managed
         Fields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:3
         6Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{
         }},"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":
         {".":{},"k:{\"uid\":\"b3f73740-2595-4276-a65c-18c78c348d08\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"ka
         thara-ws-random-96a209a2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:v
         alue":{}}},"f:image":{},"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:
         command":{}}}},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:term
         inationMessagePath":{},"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"
         /shared\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{}
         ,"f:name":{}}}}},"f:dnsConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostna
         me":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f
         :volumes":{".":{},"k:{\"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:n
         ame":{}},"k:{\"name\":\"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"man
         ager":"multus-daemon","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"Fields
         V1","fieldsV1":{"f:metadata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"statu
         s"},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"Fie
         ldsV1","fieldsV1":{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},
         "f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{
         },"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f
         :lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podI
         P":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.48.91\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"st
         atus"}]},"spec":{"volumes":[{"name":"hostlab","configMap":{"name":"kathara-ws-random-96a209a2-1tlgzbfbj9yqqt2qx
         ezkq-files","defaultMode":420}},{"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}}
         ,{"name":"kube-api-access-nw2st","projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path
         ":"token"}},{"configMap":{"name":"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI"
         :{"items":[{"path":"namespace","fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMod
         e":420}}],"containers":[{"name":"kathara-ws-random-96a209a2","image":"kathara/base","env":[{"name":"_MEGALOS_SH
         ELL","value":"/bin/bash"}],"resources":{},"volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name"
         :"shared","mountPath":"/shared"},{"name":"kube-api-access-nw2st","readOnly":true,"mountPath":"/var/run/secrets/
         kubernetes.io/serviceaccount"}],"lifecycle":{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f
         \"/tmp/post_start\" ]; then exit; else touch /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0;
         sysctl -w -q net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/ws_random\" ];
         then (cd /hostlab/ws_random \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/ws_random.startup\" ]; then chmod u+x
         /hostlab/ws_random.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/ws_random.startup;
         /hostlab/ws_random.startup \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :;
         touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb21-6g","securityContext":{},"hostname":"kathara-ws-random-96a209a2","schedulerName":"default-sche
         duler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","toleratio
         nSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeco
         nds":300}],"priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":
         "PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastPr
         obeTime":null,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null
         ,"lastTransitionTime":"2024-03-21T14:11:37Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"l
         astTransitionTime":"2024-03-21T14:11:37Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTra
         nsitionTime":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.4","podIP":"10.244.48.91","podIPs":[{"ip":"10.244.48.
         91"}],"startTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-ws-random-96a209a2","state":{"ru
         nning":{"startedAt":"2024-03-21T14:11:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/ka
         thara/base:latest","imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c664259097
         2f1c4295569c2","containerID":"containerd://a193e6d84825876ee6b5fe976fbd2b5b994d7e28ac53d0952214ed0b2c25d4e7","s
         tarted":true}],"qosClass":"BestEffort"}}]}

DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/client1.shutdown" ]; then chmod u+x
         /hostlab/client1.shutdown; /hostlab/client1.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod u+x
         /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: client1
DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/client2.shutdown" ]; then chmod u+x
         /hostlab/client2.shutdown; /hostlab/client2.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod u+x
         /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: client2
DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/server1.shutdown" ]; then chmod u+x
         /hostlab/server1.shutdown; /hostlab/server1.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod u+x
         /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: server1
DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/server2.shutdown" ]; then chmod u+x
         /hostlab/server2.shutdown; /hostlab/server2.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod u+x
         /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: server2
DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/server3.shutdown" ]; then chmod u+x
         /hostlab/server3.shutdown; /hostlab/server3.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod u+x
         /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: server3
DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-client1-5464f8f866-72n2p","generateName":"kathara-client1-5464f8f866-","namespace":"1tlgzbfbj9yqqt2qxezkq","u
         id":"fc7530a5-d0fb-49a9-8894-b7b37d9074ec","resourceVersion":"95568","creationTimestamp":"2024-03-21T14:11:36Z"
         ,"labels":{"app":"kathara","name":"client1","pod-template-hash":"5464f8f866"},"annotations":{"k8s.v1.cni.cncf.i
         o/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.16.218\"\n    ],\n    \"mac\": \"b6:c0:6f:08:fa:ac\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.16.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-a\",\n
         \"interface\": \"net0\",\n    \"mac\": \"16:b9:02:54:8b:78\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-client1-5464f8f866"
         ,"uid":"b1b06383-8a91-4f93-a8b5-67701b0f260f","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"b1b06383-8a91-4f93-a8b5-67701b0f260f\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-clien
         t1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.16.218\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"vol
         umes":[{"name":"hostlab","configMap":{"name":"kathara-client1-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},
         {"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-fgwph"
         ,"projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name"
         :"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","
         fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":
         "kathara-client1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"
         volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"k
         ube-api-access-fgwph","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle"
         :{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client1\" ]; then
         (cd /hostlab/client1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client1.startup\" ]; then chmod u+x
         /hostlab/client1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client1.startup; /hostlab/client1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb19-6g","securityContext":{},"hostname":"kathara-client1","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:37Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:37Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.2","podIP":"10.244.16.218","podIPs":[{"ip":"10.244.16.218"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-client1","state":{"running":{"startedAt":
         "2024-03-21T14:11:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://b36ce34e97f6e3d53a90a310d16f3d446b162a7ba7ab61350731104eada701ab","started":true}],"qosC
         lass":"BestEffort"}}]}

DEBUG    Executing command `['/bin/bash', '-c', 'if [ -f "/hostlab/ws_random.shutdown" ]; then chmod u+x
         /hostlab/ws_random.shutdown; /hostlab/ws_random.shutdown; fi; if [ -f "/hostlab/shared.shutdown" ]; then chmod
         u+x /hostlab/shared.shutdown; /hostlab/shared.shutdown; fi']` to device with name: ws_random
DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-server1-8b7897787-bg7bj","generateName":"kathara-server1-8b7897787-","namespace":"1tlgzbfbj9yqqt2qxezkq","uid
         ":"e2c1cea1-979c-41ef-af9e-966ee4dc44c2","resourceVersion":"95576","creationTimestamp":"2024-03-21T14:11:36Z","
         labels":{"app":"kathara","name":"server1","pod-template-hash":"8b7897787"},"annotations":{"k8s.v1.cni.cncf.io/n
         etwork-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.47.202\"\n    ],\n    \"mac\": \"86:a1:ed:3b:22:f3\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.32.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n
         \"interface\": \"net0\",\n    \"mac\": \"a6:9a:47:67:ab:48\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server1-8b7897787",
         "uid":"b9f18821-04b9-478f-9d61-c2baa256f7ea","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"m
         anager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsT
         ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:genera
         teName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{
         \"uid\":\"b9f18821-04b9-478f-9d61-c2baa256f7ea\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-server
         1\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{}
         ,"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name"
         :{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{},
         "f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f:
         mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dns
         Config":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolicy
         ":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\
         "name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":\
         "shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon","
         operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:meta
         data":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubelet
         ","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:41Z","fieldsType":"FieldsV1","fieldsV1":{"f:s
         tatus":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":
         {},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime
         ":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{}
         ,"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{
         },"k:{\"ip\":\"10.244.47.202\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-server1-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-f4xnd",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-server1","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-f4xnd","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server1\" ]; then
         (cd /hostlab/server1 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server1.startup\" ]; then chmod u+x
         /hostlab/server1.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server1.startup; /hostlab/server1.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb20-6g","securityContext":{},"hostname":"kathara-server1","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:41Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:41Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.3","podIP":"10.244.47.202","podIPs":[{"ip":"10.244.47.202"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server1","state":{"running":{"startedAt":
         "2024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://e2545917be5c539a40a00182c70ad87aa663dd0778d949927f992c149b6fd31b","started":true}],"qosC
         lass":"BestEffort"}}]}

DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-client2-5d78db459d-f4k8f","generateName":"kathara-client2-5d78db459d-","namespace":"1tlgzbfbj9yqqt2qxezkq","u
         id":"e11f71a0-0f24-4403-8a97-0c3fe00ebb5b","resourceVersion":"95561","creationTimestamp":"2024-03-21T14:11:36Z"
         ,"labels":{"app":"kathara","name":"client2","pod-template-hash":"5d78db459d"},"annotations":{"k8s.v1.cni.cncf.i
         o/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.48.90\"\n    ],\n    \"mac\": \"3e:e2:84:ea:2b:93\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.48.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-a\",\n
         \"interface\": \"net0\",\n    \"mac\": \"56:07:1f:62:fa:82\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-a\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-client2-5d78db459d"
         ,"uid":"fc640049-f58d-4a25-ae80-359b92ccce92","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"fc640049-f58d-4a25-ae80-359b92ccce92\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-clien
         t2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.48.90\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-client2-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-c4xbx",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-client2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-c4xbx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/client2\" ]; then
         (cd /hostlab/client2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/client2.startup\" ]; then chmod u+x
         /hostlab/client2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/client2.startup; /hostlab/client2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb21-6g","securityContext":{},"hostname":"kathara-client2","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:37Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:37Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.4","podIP":"10.244.48.90","podIPs":[{"ip":"10.244.48.90"}],"star
         tTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-client2","state":{"running":{"startedAt":"2
         024-03-21T14:11:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","im
         ageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","contai
         nerID":"containerd://9f075399c17eec5c212b026f2b9b4184ae90d016a9fec7782225aa0d98ab1ed2","started":true}],"qosCla
         ss":"BestEffort"}}]}

DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-server3-7557bbf76c-hx7cc","generateName":"kathara-server3-7557bbf76c-","namespace":"1tlgzbfbj9yqqt2qxezkq","u
         id":"2194cc6b-ac6e-49cb-a8ba-c41cacf7d8fa","resourceVersion":"95578","creationTimestamp":"2024-03-21T14:11:36Z"
         ,"labels":{"app":"kathara","name":"server3","pod-template-hash":"7557bbf76c"},"annotations":{"k8s.v1.cni.cncf.i
         o/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.47.203\"\n    ],\n    \"mac\": \"42:5c:e8:30:0e:38\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.32.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n
         \"interface\": \"net0\",\n    \"mac\": \"2a:c7:21:28:19:da\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server3-7557bbf76c"
         ,"uid":"89f98a3d-4871-4358-b98c-fcd63a681baa","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"89f98a3d-4871-4358-b98c-fcd63a681baa\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-serve
         r3\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:41Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.47.203\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"vol
         umes":[{"name":"hostlab","configMap":{"name":"kathara-server3-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},
         {"name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-7kk8p"
         ,"projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name"
         :"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","
         fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":
         "kathara-server3","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"
         volumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"k
         ube-api-access-7kk8p","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle"
         :{"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server3\" ]; then
         (cd /hostlab/server3 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server3.startup\" ]; then chmod u+x
         /hostlab/server3.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server3.startup; /hostlab/server3.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb20-6g","securityContext":{},"hostname":"kathara-server3","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:41Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:41Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.3","podIP":"10.244.47.203","podIPs":[{"ip":"10.244.47.203"}],"st
         artTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server3","state":{"running":{"startedAt":
         "2024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","
         imageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","cont
         ainerID":"containerd://a153cd735bb9f049d635acb7d2b2af50bf7886332c1f9afca8ed7931ed526511","started":true}],"qosC
         lass":"BestEffort"}}]}

DEBUG    response body:
         {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"95658"},"items":[{"metadata":{"name":"kathar
         a-server2-59fb79f9f9-bxt7k","generateName":"kathara-server2-59fb79f9f9-","namespace":"1tlgzbfbj9yqqt2qxezkq","u
         id":"6cb7bb08-39ae-48d2-a40d-9cd2da67e361","resourceVersion":"95582","creationTimestamp":"2024-03-21T14:11:36Z"
         ,"labels":{"app":"kathara","name":"server2","pod-template-hash":"59fb79f9f9"},"annotations":{"k8s.v1.cni.cncf.i
         o/network-status":"[{\n    \"name\": \"cbr0\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n
         \"10.244.48.92\"\n    ],\n    \"mac\": \"2a:4e:4c:5f:ee:4f\",\n    \"default\": true,\n    \"dns\": {},\n
         \"gateway\": [\n        \"10.244.48.1\"\n    ]\n},{\n    \"name\": \"1tlgzbfbj9yqqt2qxezkq/kathara-b\",\n
         \"interface\": \"net0\",\n    \"mac\": \"82:69:eb:ce:e1:48\",\n    \"dns\":
         {}\n}]","k8s.v1.cni.cncf.io/networks":"[{\"name\": \"kathara-b\", \"namespace\": \"1tlgzbfbj9yqqt2qxezkq\",
         \"interface\":
         \"net0\"}]"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kathara-server2-59fb79f9f9"
         ,"uid":"6e01ade8-1c66-4ea1-bab3-b1c7cc54f4dd","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"
         manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:36Z","fields
         Type":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:k8s.v1.cni.cncf.io/networks":{}},"f:gener
         ateName":{},"f:labels":{".":{},"f:app":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:
         {\"uid\":\"6e01ade8-1c66-4ea1-bab3-b1c7cc54f4dd\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"kathara-serve
         r2\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"_MEGALOS_SHELL\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{
         },"f:imagePullPolicy":{},"f:lifecycle":{".":{},"f:postStart":{".":{},"f:exec":{".":{},"f:command":{}}}},"f:name
         ":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:stdin":{},"f:terminationMessagePath":{}
         ,"f:terminationMessagePolicy":{},"f:tty":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/shared\"}":{".":{},"f
         :mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/tmp/kathara\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dn
         sConfig":{".":{},"f:nameservers":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:restartPolic
         y":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{
         \"name\":\"hostlab\"}":{".":{},"f:configMap":{".":{},"f:defaultMode":{},"f:name":{}},"f:name":{}},"k:{\"name\":
         \"shared\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}}}}}},{"manager":"multus-daemon",
         "operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:37Z","fieldsType":"FieldsV1","fieldsV1":{"f:met
         adata":{"f:annotations":{"f:k8s.v1.cni.cncf.io/network-status":{}}}},"subresource":"status"},{"manager":"kubele
         t","operation":"Update","apiVersion":"v1","time":"2024-03-21T14:11:42Z","fieldsType":"FieldsV1","fieldsV1":{"f:
         status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime"
         :{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTim
         e":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{
         },"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":
         {},"k:{\"ip\":\"10.244.48.92\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volu
         mes":[{"name":"hostlab","configMap":{"name":"kathara-server2-1tlgzbfbj9yqqt2qxezkq-files","defaultMode":420}},{
         "name":"shared","hostPath":{"path":"/home/shared","type":"DirectoryOrCreate"}},{"name":"kube-api-access-j4stj",
         "projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":
         "kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","f
         ieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"
         kathara-server2","image":"kathara/base","env":[{"name":"_MEGALOS_SHELL","value":"/bin/bash"}],"resources":{},"v
         olumeMounts":[{"name":"hostlab","mountPath":"/tmp/kathara"},{"name":"shared","mountPath":"/shared"},{"name":"ku
         be-api-access-j4stj","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"lifecycle":
         {"postStart":{"exec":{"command":["/bin/bash","-c","if [ -f \"/tmp/post_start\" ]; then exit; else touch
         /tmp/post_start; fi; sysctl -w -q net.ipv4.conf.all.rp_filter=0; sysctl -w -q
         net.ipv4.conf.default.rp_filter=0; sysctl -w -q net.ipv4.conf.lo.rp_filter=0; sysctl -w -q
         net.ipv4.ip_forward=1; sysctl -w -q net.ipv4.icmp_ratelimit=0; rm -Rf /etc/bind/*; umount /etc/resolv.conf;
         umount /etc/hosts; if [ -f \"/tmp/kathara/hostlab.b64\" ]; then base64 -d /tmp/kathara/hostlab.b64 \u003e
         /hostlab.tar.gz; tar xmfz /hostlab.tar.gz -C /; rm -f hostlab.tar.gz; fi; if [ -d \"/hostlab/server2\" ]; then
         (cd /hostlab/server2 \u0026\u0026 tar c .) | (cd / \u0026\u0026 tar xhf - --no-same-owner
         --no-same-permissions); fi; if [ ! -s \"/etc/hosts\" ]; then echo '127.0.0.1 localhost' \u003e /etc/hosts; echo
         '::1 localhost' \u003e\u003e /etc/hosts; fi; if [ -d \"/var/www\" ]; then chmod -R 777 /var/www/*; fi; if [ -d
         \"/etc/quagga\" ]; then chown -R quagga:quagga /etc/quagga/; chmod 640 /etc/quagga/*; fi; if [ -d \"/etc/frr\"
         ]; then chown -R frr:frr /etc/frr/; chmod 640 /etc/frr/*; fi; if [ -f \"/hostlab/shared.startup\" ]; then chmod
         u+x /hostlab/shared.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/shared.startup; /hostlab/shared.startup
         \u0026\u003e /var/log/shared.log; fi; if [ -f \"/hostlab/server2.startup\" ]; then chmod u+x
         /hostlab/server2.startup; sed -i \"1s;^;set -x\\n\\n;\" /hostlab/server2.startup; /hostlab/server2.startup
         \u0026\u003e /var/log/startup.log; fi; ip route del default dev eth0 || true; :; touch
         /tmp/EOS"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolic
         y":"IfNotPresent","securityContext":{"privileged":true},"stdin":true,"tty":true}],"restartPolicy":"Always","ter
         minationGracePeriodSeconds":30,"dnsPolicy":"None","serviceAccountName":"default","serviceAccount":"default","no
         deName":"i72tb21-6g","securityContext":{},"hostname":"kathara-server2","schedulerName":"default-scheduler","tol
         erations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":3
         00},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],
         "priority":0,"dnsConfig":{"nameservers":["127.0.0.1"]},"enableServiceLinks":true,"preemptionPolicy":"PreemptLow
         erPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":nu
         ll,"lastTransitionTime":"2024-03-21T14:11:36Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTrans
         itionTime":"2024-03-21T14:11:42Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransiti
         onTime":"2024-03-21T14:11:42Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime
         ":"2024-03-21T14:11:36Z"}],"hostIP":"192.168.0.4","podIP":"10.244.48.92","podIPs":[{"ip":"10.244.48.92"}],"star
         tTime":"2024-03-21T14:11:36Z","containerStatuses":[{"name":"kathara-server2","state":{"running":{"startedAt":"2
         024-03-21T14:11:37Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"docker.io/kathara/base:latest","im
         ageID":"docker.io/kathara/base@sha256:a20d4029ae5f17bac32f5b252c87569b32f9e1af9c6642590972f1c4295569c2","contai
         nerID":"containerd://f198011648fa938a7dbc7ea82012fffa9d2290ab8463f3674df4e5a58cea7332","started":true}],"qosCla
         ss":"BestEffort"}}]}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server1-1tlgzbfb
         j9yqqt2qxezkq-files","kind":"configmaps","uid":"665df30b-5015-4931-ad48-8d984321a4d2"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-client2-1tlgzbfb
         j9yqqt2qxezkq-files","kind":"configmaps","uid":"41ae0d41-481c-4402-8d94-bfac69ecf2ae"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-client1-1tlgzbfb
         j9yqqt2qxezkq-files","kind":"configmaps","uid":"f4607c7f-da65-4a83-b885-bf268b61d403"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server1","group"
         :"apps","kind":"deployments","uid":"7a969b65-a259-4eba-90f5-96aa50b0ebe3"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server3-1tlgzbfb
         j9yqqt2qxezkq-files","kind":"configmaps","uid":"a5911e92-7859-476b-ade3-1f9301f2c4cc"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-client2","group"
         :"apps","kind":"deployments","uid":"0e4212b7-ee76-493e-a51e-2de826ab12be"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server3","group"
         :"apps","kind":"deployments","uid":"a4871d48-26c4-4acd-9f0f-f5b460e85792"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-client1","group"
         :"apps","kind":"deployments","uid":"326185e0-40f7-4267-a355-3f19c033b36d"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server2-1tlgzbfb
         j9yqqt2qxezkq-files","kind":"configmaps","uid":"52f4668c-c261-4b9c-99b4-00eeec4c2039"}}

DEBUG    response body:
         {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"kathara-server2","group"
         :"apps","kind":"deployments","uid":"55b0fa77-a873-47c4-aa04-4cb15935b416"}}

DEBUG    Event: ADDED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: ADDED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: ADDED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: ADDED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: ADDED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: ADDED - Pod: kathara-ws-random-96a209a2-57fc58b887-hxxcs (Device ws_random)
DEBUG    Event: MODIFIED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: MODIFIED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: MODIFIED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: MODIFIED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: MODIFIED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: MODIFIED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: DELETED - Pod: kathara-client2-5d78db459d-f4k8f (Device client2)
DEBUG    Event: MODIFIED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: DELETED - Pod: kathara-server2-59fb79f9f9-bxt7k (Device server2)
DEBUG    Event: MODIFIED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: MODIFIED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: MODIFIED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: MODIFIED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: DELETED - Pod: kathara-client1-5464f8f866-72n2p (Device client1)
DEBUG    Event: MODIFIED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: MODIFIED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: MODIFIED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: DELETED - Pod: kathara-server1-8b7897787-bg7bj (Device server1)
DEBUG    Event: MODIFIED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)
DEBUG    Event: DELETED - Pod: kathara-server3-7557bbf76c-hx7cc (Device server3)

BMG-DYNAMIT · 2024-03-21T15:11:14Z

I noticed it only happens sometimes. With more machines it happens more often, like in the following lab: Kathara-Labs/main-labs/application-level/load-balancer-random/kathara-lab_load-balancer-ws-rnd

Skazza94 · 2024-03-22T10:31:43Z

Hi @BMG-DYNAMIT,
I was not able to exactly reproduce your issue on the same lab, but looking at the logs that you provided maybe I understood the cause of the problem. What happens is that one of the devices was not correctly added to the deletion watchlist, so the lclean command was hanging waiting for the device deletion (which was never being tracked).

I should have patched this behaviour by moving the deploy/undeploy watchlists methods in a separate thread, that is started before the actual deployment/undeployment of devices is started. Before merging this change in the develop branch for the next release, I kindly ask you to test it in your environment and let me know if the problem has gone.

You can find the patched code in the 277-not-all-pods-are-terminating-with-kubernetes-and-kathara-373 branch. Please pull the code and use Kathará from the source code.

Install the requirements in src:

python3 -m pip install src/requirements.txt

And then you can use:

python3 src/kathara.py lstart ...

To test it.

Thanks,
Mariano.

BMG-DYNAMIT · 2024-03-22T13:36:45Z

Hi @Skazza94 ,

Thank you for your time and nice work!

I tested you changes in my environment and it works now!

Before:

ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-1-0-1-116c4f21-b4c87b9dd-x4qcf      1/1     Terminating   0          19s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-1-0-2-f785a2fb-6bc9498cf9-sdn9m     1/1     Terminating   0          19s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-2-0-1-238f4cb1-cf46b566d-565d5      1/1     Terminating   0          17s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-2-0-2-a96dace5-58f8d4747-gxqb2      1/1     Terminating   0          19s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-1-1-ca0c80e6-7b4495ffcf-xgm8f   1/1     Terminating   0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-1-2-3bd77e5c-5649f7f5d9-fbpj8   1/1     Terminating   0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-2-1-46b939e2-7fcc4dbbfb-tj69t   1/1     Terminating   0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-2-2-d3dc392b-6bb7d987d6-qdp5v   1/1     Terminating   0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-1-1-9065595b-97f5d58d-jzz9c     1/1     Terminating   0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-1-2-18acc3f8-586f97fd4c-fccmd   1/1     Running       0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-2-1-733f83b8-8785d56d4-llx9g    1/1     Running       0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-2-2-5af1c827-78fcffbc6-t9n66    1/1     Running       0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-1-1-1-de87967a-6f66654556-28wtf    1/1     Running       0          19s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-1-1-2-8bea2587-7dcd88b87f-qgxvf    1/1     Running       0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-2-1-1-870f39bf-54785d79fd-xk2xd    1/1     Running       0          19s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-2-1-2-b2da42ea-56f9599546-cx84f    1/1     Running       0          18s
ssxo0hvwnhk5ltkn5mxgaq   kathara-tof-1-2-1-a95ebb2a-698b86f798-jd7pr      1/1     Running       0          20s
ssxo0hvwnhk5ltkn5mxgaq   kathara-tof-1-2-2-326b8173-84556b9d7c-bt4bw      1/1     Running       0          18s

After:

ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-1-0-1-116c4f21-b4c87b9dd-sthl6      1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-1-0-2-f785a2fb-6bc9498cf9-2d9gv     1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-2-0-1-238f4cb1-cf46b566d-v5zf5      1/1     Terminating   0          28s
ssxo0hvwnhk5ltkn5mxgaq   kathara-leaf-2-0-2-a96dace5-58f8d4747-zljxt      1/1     Terminating   0          28s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-1-1-ca0c80e6-7b4495ffcf-645ll   1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-1-2-3bd77e5c-5649f7f5d9-kbfg2   1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-2-1-46b939e2-7fcc4dbbfb-6l9v6   1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-1-2-2-d3dc392b-6bb7d987d6-h9zpw   1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-1-1-9065595b-97f5d58d-pkh29     1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-1-2-18acc3f8-586f97fd4c-knlbs   1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-2-1-733f83b8-8785d56d4-vckkl    1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-server-2-2-2-5af1c827-78fcffbc6-7sbx9    1/1     Terminating   0          30s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-1-1-1-de87967a-6f66654556-fsx4g    1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-1-1-2-8bea2587-7dcd88b87f-fcxwg    1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-2-1-1-870f39bf-54785d79fd-9hk8v    1/1     Terminating   0          28s
ssxo0hvwnhk5ltkn5mxgaq   kathara-spine-2-1-2-b2da42ea-56f9599546-ggb4x    1/1     Terminating   0          27s
ssxo0hvwnhk5ltkn5mxgaq   kathara-tof-1-2-1-a95ebb2a-698b86f798-cv74z      1/1     Terminating   0          29s
ssxo0hvwnhk5ltkn5mxgaq   kathara-tof-1-2-2-326b8173-84556b9d7c-wxhcc      1/1     Terminating   0          28s

Thanks,
Moritz

Skazza94 · 2024-03-22T13:41:09Z

Hi @BMG-DYNAMIT,
thanks for your time in testing it 😄

I will merge the patch in develop and we will release it in Kathará 3.7.4

Skazza94 self-assigned this Mar 22, 2024

Skazza94 added bug manager/kubernetes labels Mar 22, 2024

Skazza94 added this to Kathara Framework Development Board Mar 22, 2024

Skazza94 added this to the Release 3.7.4 milestone Mar 22, 2024

Skazza94 added a commit that referenced this issue Mar 22, 2024

Move k8s wait methods in another thread to avoid stucking (#277)

2fafdaf

Skazza94 moved this to In Progress in Kathara Framework Development Board Mar 22, 2024

Skazza94 moved this from In Progress to Done in Kathara Framework Development Board Mar 22, 2024

tcaiazzi mentioned this issue Mar 27, 2024

Kathará v3.7.4 #280

Merged

tcaiazzi closed this as completed Mar 27, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Not all Pods are Terminating with Kubernetes and Kathara 3.7.3 #277

Not all Pods are Terminating with Kubernetes and Kathara 3.7.3 #277

BMG-DYNAMIT commented Mar 20, 2024 •

edited

Loading

BMG-DYNAMIT commented Mar 20, 2024

BMG-DYNAMIT commented Mar 20, 2024

Skazza94 commented Mar 21, 2024

BMG-DYNAMIT commented Mar 21, 2024 •

edited

Loading

BMG-DYNAMIT commented Mar 21, 2024

Skazza94 commented Mar 22, 2024

BMG-DYNAMIT commented Mar 22, 2024

Skazza94 commented Mar 22, 2024

Not all Pods are Terminating with Kubernetes and Kathara 3.7.3 #277

Not all Pods are Terminating with Kubernetes and Kathara 3.7.3 #277

Comments

BMG-DYNAMIT commented Mar 20, 2024 • edited Loading

Operating System

Kathará Version

Bug Description

Steps To Reproduce

Expected Behavior

Check Command Output

BMG-DYNAMIT commented Mar 20, 2024

BMG-DYNAMIT commented Mar 20, 2024

Skazza94 commented Mar 21, 2024

BMG-DYNAMIT commented Mar 21, 2024 • edited Loading

BMG-DYNAMIT commented Mar 21, 2024

Skazza94 commented Mar 22, 2024

BMG-DYNAMIT commented Mar 22, 2024

Skazza94 commented Mar 22, 2024

BMG-DYNAMIT commented Mar 20, 2024 •

edited

Loading

BMG-DYNAMIT commented Mar 21, 2024 •

edited

Loading