Sep 30 07:18:18 localhost kernel: Linux version 6.6.48-flatcar (build@pony-truck.infra.kinvolk.io) (x86_64-cros-linux-gnu-gcc (Gentoo Hardened 13.2.1_p20240210 p14) 13.2.1 20240210, GNU ld (Gentoo 2.41 p5) 2.41.0) #1 SMP PREEMPT_DYNAMIC Wed Sep 4 15:49:08 -00 2024 Sep 30 07:18:18 localhost kernel: Command line: BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: BIOS-provided physical RAM map: Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009efff] usable Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x000000000009f000-0x000000000009ffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000000e4000-0x00000000000fffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000dfe7ffff] usable Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfe80000-0x00000000dfe97fff] ACPI data Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfe98000-0x00000000dfebffff] ACPI NVS Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfec0000-0x00000000dfefffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000100000000-0x000000051cffffff] usable Sep 30 07:18:18 localhost kernel: NX (Execute Disable) protection: active Sep 30 07:18:18 localhost kernel: APIC: Static calls initialized Sep 30 07:18:18 localhost kernel: SMBIOS 2.5 present. Sep 30 07:18:18 localhost kernel: DMI: System manufacturer System Product Name/M5A78L-M/USB3, BIOS 2101 12/02/2014 Sep 30 07:18:18 localhost kernel: tsc: Fast TSC calibration using PIT Sep 30 07:18:18 localhost kernel: tsc: Detected 3214.344 MHz processor Sep 30 07:18:18 localhost kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Sep 30 07:18:18 localhost kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Sep 30 07:18:18 localhost kernel: AGP: No AGP bridge found Sep 30 07:18:18 localhost kernel: last_pfn = 0x51d000 max_arch_pfn = 0x400000000 Sep 30 07:18:18 localhost kernel: MTRR map: 5 entries (3 fixed + 2 variable; max 20), built from 9 variable MTRRs Sep 30 07:18:18 localhost kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Sep 30 07:18:18 localhost kernel: e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved Sep 30 07:18:18 localhost kernel: last_pfn = 0xdfe80 max_arch_pfn = 0x400000000 Sep 30 07:18:18 localhost kernel: Using GB pages for direct mapping Sep 30 07:18:18 localhost kernel: ACPI: Early table checksum verification disabled Sep 30 07:18:18 localhost kernel: ACPI: RSDP 0x00000000000FB490 000024 (v02 ACPIAM) Sep 30 07:18:18 localhost kernel: ACPI: XSDT 0x00000000DFE80100 000054 (v01 120214 XSDT0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: FACP 0x00000000DFE80290 0000F4 (v03 120214 FACP0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20230628/tbfadt-615) Sep 30 07:18:18 localhost kernel: ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 64/32 (20230628/tbfadt-564) Sep 30 07:18:18 localhost kernel: ACPI: DSDT 0x00000000DFE80460 00DBCE (v01 A1887 A1887001 00000001 INTL 20060113) Sep 30 07:18:18 localhost kernel: ACPI: FACS 0x00000000DFE98000 000040 Sep 30 07:18:18 localhost kernel: ACPI: FACS 0x00000000DFE98000 000040 Sep 30 07:18:18 localhost kernel: ACPI: APIC 0x00000000DFE80390 00008C (v01 120214 APIC0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: MCFG 0x00000000DFE80420 00003C (v01 120214 OEMMCFG 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: OEMB 0x00000000DFE98040 000072 (v01 120214 OEMB0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: HPET 0x00000000DFE8F460 000038 (v01 120214 OEMHPET 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: SSDT 0x00000000DFE8F4A0 001714 (v01 A M I POWERNOW 00000001 AMD 00000001) Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACP table memory at [mem 0xdfe80290-0xdfe80383] Sep 30 07:18:18 localhost kernel: ACPI: Reserving DSDT table memory at [mem 0xdfe80460-0xdfe8e02d] Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACS table memory at [mem 0xdfe98000-0xdfe9803f] Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACS table memory at [mem 0xdfe98000-0xdfe9803f] Sep 30 07:18:18 localhost kernel: ACPI: Reserving APIC table memory at [mem 0xdfe80390-0xdfe8041b] Sep 30 07:18:18 localhost kernel: ACPI: Reserving MCFG table memory at [mem 0xdfe80420-0xdfe8045b] Sep 30 07:18:18 localhost kernel: ACPI: Reserving OEMB table memory at [mem 0xdfe98040-0xdfe980b1] Sep 30 07:18:18 localhost kernel: ACPI: Reserving HPET table memory at [mem 0xdfe8f460-0xdfe8f497] Sep 30 07:18:18 localhost kernel: ACPI: Reserving SSDT table memory at [mem 0xdfe8f4a0-0xdfe90bb3] Sep 30 07:18:18 localhost kernel: No NUMA configuration found Sep 30 07:18:18 localhost kernel: Faking a node at [mem 0x0000000000000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: NODE_DATA(0) allocated [mem 0x51cffa000-0x51cffffff] Sep 30 07:18:18 localhost kernel: Zone ranges: Sep 30 07:18:18 localhost kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Sep 30 07:18:18 localhost kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Sep 30 07:18:18 localhost kernel: Normal [mem 0x0000000100000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: Movable zone start for each node Sep 30 07:18:18 localhost kernel: Early memory node ranges Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000000100000-0x00000000dfe7ffff] Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000100000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: On node 0, zone DMA: 1 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone DMA: 97 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone Normal: 384 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone Normal: 12288 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: ACPI: PM-Timer IO Port: 0x808 Sep 30 07:18:18 localhost kernel: IOAPIC[0]: apic_id 24, version 33, address 0xfec00000, GSI 0-23 Sep 30 07:18:18 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Sep 30 07:18:18 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) Sep 30 07:18:18 localhost kernel: ACPI: Using ACPI (MADT) for SMP configuration information Sep 30 07:18:18 localhost kernel: ACPI: HPET id: 0x8300 base: 0xfed00000 Sep 30 07:18:18 localhost kernel: smpboot: Allowing 8 CPUs, 0 hotplug CPUs Sep 30 07:18:18 localhost kernel: [mem 0xdff00000-0xffdfffff] available for PCI devices Sep 30 07:18:18 localhost kernel: Booting paravirtualized kernel on bare hardware Sep 30 07:18:18 localhost kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Sep 30 07:18:18 localhost kernel: setup_percpu: NR_CPUS:512 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 Sep 30 07:18:18 localhost kernel: percpu: Embedded 58 pages/cpu s196904 r8192 d32472 u262144 Sep 30 07:18:18 localhost kernel: pcpu-alloc: s196904 r8192 d32472 u262144 alloc=1*2097152 Sep 30 07:18:18 localhost kernel: pcpu-alloc: [0] 0 1 2 3 4 5 6 7 Sep 30 07:18:18 localhost kernel: Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-b biosdevname=0", will be passed to user space. Sep 30 07:18:18 localhost kernel: Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Sep 30 07:18:18 localhost kernel: Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) Sep 30 07:18:18 localhost kernel: Fallback order for Node 0: 0 Sep 30 07:18:18 localhost kernel: Built 1 zonelists, mobility grouping on. Total pages: 5148230 Sep 30 07:18:18 localhost kernel: Policy zone: Normal Sep 30 07:18:18 localhost kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Sep 30 07:18:18 localhost kernel: AGP: Checking aperture... Sep 30 07:18:18 localhost kernel: AGP: No AGP bridge found Sep 30 07:18:18 localhost kernel: AGP: Node 0: aperture [bus addr 0x00000000-0x01ffffff] (32MB) Sep 30 07:18:18 localhost kernel: AGP: Your BIOS doesn't leave an aperture memory hole Sep 30 07:18:18 localhost kernel: AGP: Please enable the IOMMU option in the BIOS setup Sep 30 07:18:18 localhost kernel: AGP: This costs you 64MB of RAM Sep 30 07:18:18 localhost kernel: AGP: Mapping aperture over RAM [mem 0xd8000000-0xdbffffff] (65536KB) Sep 30 07:18:18 localhost kernel: software IO TLB: area num 8. Sep 30 07:18:18 localhost kernel: Memory: 20314604K/20920440K available (12288K kernel code, 2303K rwdata, 22640K rodata, 49336K init, 2008K bss, 605576K reserved, 0K cma-reserved) Sep 30 07:18:18 localhost kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 Sep 30 07:18:18 localhost kernel: ftrace: allocating 37670 entries in 148 pages Sep 30 07:18:18 localhost kernel: ftrace: allocated 148 pages with 3 groups Sep 30 07:18:18 localhost kernel: Dynamic Preempt: voluntary Sep 30 07:18:18 localhost kernel: rcu: Preemptible hierarchical RCU implementation. Sep 30 07:18:18 localhost kernel: rcu: RCU event tracing is enabled. Sep 30 07:18:18 localhost kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=8. Sep 30 07:18:18 localhost kernel: Trampoline variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: Rude variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: Tracing variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Sep 30 07:18:18 localhost kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 Sep 30 07:18:18 localhost kernel: NR_IRQS: 33024, nr_irqs: 488, preallocated irqs: 16 Sep 30 07:18:18 localhost kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Sep 30 07:18:18 localhost kernel: spurious 8259A interrupt: IRQ7. Sep 30 07:18:18 localhost kernel: Console: colour VGA+ 80x25 Sep 30 07:18:18 localhost kernel: printk: console [tty0] enabled Sep 30 07:18:18 localhost kernel: printk: console [ttyS0] enabled Sep 30 07:18:18 localhost kernel: ACPI: Core revision 20230628 Sep 30 07:18:18 localhost kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns Sep 30 07:18:18 localhost kernel: APIC: Switch to symmetric I/O mode setup Sep 30 07:18:18 localhost kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Sep 30 07:18:18 localhost kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2e5537fab7e, max_idle_ns: 440795243159 ns Sep 30 07:18:18 localhost kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 6428.68 BogoMIPS (lpj=3214344) Sep 30 07:18:18 localhost kernel: LVT offset 1 assigned for vector 0xf9 Sep 30 07:18:18 localhost kernel: Last level iTLB entries: 4KB 512, 2MB 1024, 4MB 512 Sep 30 07:18:18 localhost kernel: Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 512, 1GB 0 Sep 30 07:18:18 localhost kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Sep 30 07:18:18 localhost kernel: Spectre V2 : Mitigation: Retpolines Sep 30 07:18:18 localhost kernel: Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Sep 30 07:18:18 localhost kernel: Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Sep 30 07:18:18 localhost kernel: Spectre V2 : Enabling Speculation Barrier for firmware calls Sep 30 07:18:18 localhost kernel: RETBleed: Mitigation: untrained return thunk Sep 30 07:18:18 localhost kernel: Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Sep 30 07:18:18 localhost kernel: Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Sep 30 07:18:18 localhost kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Sep 30 07:18:18 localhost kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Sep 30 07:18:18 localhost kernel: Freeing SMP alternatives memory: 32K Sep 30 07:18:18 localhost kernel: pid_max: default: 32768 minimum: 301 Sep 30 07:18:18 localhost kernel: LSM: initializing lsm=lockdown,capability,selinux,integrity Sep 30 07:18:18 localhost kernel: SELinux: Initializing. Sep 30 07:18:18 localhost kernel: Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: smpboot: CPU0: AMD FX-8320E Eight-Core Processor (family: 0x15, model: 0x2, stepping: 0x0) Sep 30 07:18:18 localhost kernel: RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: Performance Events: Fam15h core perfctr, AMD PMU driver. Sep 30 07:18:18 localhost kernel: ... version: 0 Sep 30 07:18:18 localhost kernel: ... bit width: 48 Sep 30 07:18:18 localhost kernel: ... generic registers: 6 Sep 30 07:18:18 localhost kernel: ... value mask: 0000ffffffffffff Sep 30 07:18:18 localhost kernel: ... max period: 00007fffffffffff Sep 30 07:18:18 localhost kernel: ... fixed-purpose events: 0 Sep 30 07:18:18 localhost kernel: ... event mask: 000000000000003f Sep 30 07:18:18 localhost kernel: signal: max sigframe size: 1776 Sep 30 07:18:18 localhost kernel: rcu: Hierarchical SRCU implementation. Sep 30 07:18:18 localhost kernel: rcu: Max phase no-delay instances is 400. Sep 30 07:18:18 localhost kernel: NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. Sep 30 07:18:18 localhost kernel: smp: Bringing up secondary CPUs ... Sep 30 07:18:18 localhost kernel: smpboot: x86: Booting SMP configuration: Sep 30 07:18:18 localhost kernel: .... node #0, CPUs: #2 #4 #6 #1 #3 #5 #7 Sep 30 07:18:18 localhost kernel: smp: Brought up 1 node, 8 CPUs Sep 30 07:18:18 localhost kernel: smpboot: Max logical packages: 1 Sep 30 07:18:18 localhost kernel: smpboot: Total of 8 processors activated (51429.50 BogoMIPS) Sep 30 07:18:18 localhost kernel: devtmpfs: initialized Sep 30 07:18:18 localhost kernel: x86/mm: Memory block size: 128MB Sep 30 07:18:18 localhost kernel: ACPI: PM: Registering ACPI NVS region [mem 0xdfe98000-0xdfebffff] (163840 bytes) Sep 30 07:18:18 localhost kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Sep 30 07:18:18 localhost kernel: futex hash table entries: 2048 (order: 5, 131072 bytes, linear) Sep 30 07:18:18 localhost kernel: pinctrl core: initialized pinctrl subsystem Sep 30 07:18:18 localhost kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Sep 30 07:18:18 localhost kernel: audit: initializing netlink subsys (disabled) Sep 30 07:18:18 localhost kernel: audit: type=2000 audit(1727680694.257:1): state=initialized audit_enabled=0 res=1 Sep 30 07:18:18 localhost kernel: thermal_sys: Registered thermal governor 'step_wise' Sep 30 07:18:18 localhost kernel: thermal_sys: Registered thermal governor 'user_space' Sep 30 07:18:18 localhost kernel: cpuidle: using governor menu Sep 30 07:18:18 localhost kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Sep 30 07:18:18 localhost kernel: dca service started, version 1.12.1 Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) Sep 30 07:18:18 localhost kernel: PCI: not using MMCONFIG Sep 30 07:18:18 localhost kernel: PCI: Using configuration type 1 for base access Sep 30 07:18:18 localhost kernel: PCI: Using configuration type 1 for extended access Sep 30 07:18:18 localhost kernel: kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Sep 30 07:18:18 localhost kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Sep 30 07:18:18 localhost kernel: HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page Sep 30 07:18:18 localhost kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Sep 30 07:18:18 localhost kernel: HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Module Device) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Processor Device) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Processor Aggregator Device) Sep 30 07:18:18 localhost kernel: ACPI: 2 ACPI AML tables successfully acquired and loaded Sep 30 07:18:18 localhost kernel: ACPI: _OSC evaluation for CPUs failed, trying _PDC Sep 30 07:18:18 localhost kernel: ACPI: Interpreter enabled Sep 30 07:18:18 localhost kernel: ACPI: PM: (supports S0 S1 S3 S5) Sep 30 07:18:18 localhost kernel: ACPI: Using IOAPIC for interrupt routing Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved as ACPI motherboard resource Sep 30 07:18:18 localhost kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Sep 30 07:18:18 localhost kernel: PCI: Using E820 reservations for host bridge windows Sep 30 07:18:18 localhost kernel: ACPI: Enabled 7 GPEs in block 00 to 1F Sep 30 07:18:18 localhost kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Sep 30 07:18:18 localhost kernel: acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Sep 30 07:18:18 localhost kernel: PCI host bridge to bus 0000:00 Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:00.0: [1022:9600] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: [1043:9602] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: [1022:9607] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: enabling Extended Tags Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PME# supported from D0 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: [1022:9609] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: enabling Extended Tags Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: [1002:4391] type 00 class 0x010601 Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x10: [io 0xc000-0xc007] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x14: [io 0xb000-0xb003] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x18: [io 0xa000-0xa007] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x1c: [io 0x9000-0x9003] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x20: [io 0x8000-0x800f] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x24: [mem 0xfe8ffc00-0xfe8fffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.0: [1002:4397] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.0: reg 0x10: [mem 0xfe8fe000-0xfe8fefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.1: [1002:4398] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.1: reg 0x10: [mem 0xfe8fd000-0xfe8fdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: [1002:4396] type 00 class 0x0c0320 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: reg 0x10: [mem 0xfe8ff800-0xfe8ff8ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: PME# supported from D0 D1 D2 D3hot Sep 30 07:18:18 localhost kernel: pci 0000:00:13.0: [1002:4397] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.0: reg 0x10: [mem 0xfe8fc000-0xfe8fcfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.1: [1002:4398] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.1: reg 0x10: [mem 0xfe8fb000-0xfe8fbfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: [1002:4396] type 00 class 0x0c0320 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: reg 0x10: [mem 0xfe8ff400-0xfe8ff4ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: PME# supported from D0 D1 D2 D3hot Sep 30 07:18:18 localhost kernel: pci 0000:00:14.0: [1002:4385] type 00 class 0x0c0500 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: [1002:439c] type 00 class 0x01018a Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x10: [io 0x0000-0x0007] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x14: [io 0x0000-0x0003] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x18: [io 0x0000-0x0007] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x1c: [io 0x0000-0x0003] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x20: [io 0xff00-0xff0f] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.3: [1002:439d] type 00 class 0x060100 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: [1002:4384] type 01 class 0x060401 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.5: [1002:4399] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.5: reg 0x10: [mem 0xfe8fa000-0xfe8fafff] Sep 30 07:18:18 localhost kernel: pci 0000:00:18.0: [1022:1600] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.1: [1022:1601] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.2: [1022:1602] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.3: [1022:1603] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.4: [1022:1604] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.5: [1022:1605] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: extended config space not accessible Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: [1002:9616] type 00 class 0x030000 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x10: [mem 0xfa000000-0xfbffffff pref] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x14: [io 0xd000-0xd0ff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x18: [mem 0xfeaf0000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x24: [mem 0xfe900000-0xfe9fffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: [1002:960f] type 00 class 0x040300 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: reg 0x10: [mem 0xfeae8000-0xfeaebfff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: PCI bridge to [bus 01] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: [1b21:1142] type 00 class 0x0c0330 Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: reg 0x10: [mem 0xfebf0000-0xfebf7fff 64bit] Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: PME# supported from D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PCI bridge to [bus 02] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: bridge window [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: [10ec:8168] type 00 class 0x020000 Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x10: [io 0xe800-0xe8ff] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x18: [mem 0xfdfff000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x20: [mem 0xfdff8000-0xfdffbfff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PCI bridge to [bus 03] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: extended config space not accessible Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: PCI bridge to [bus 04] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [io 0x0000-0x0cf7 window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [io 0x0d00-0xffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0x000d0000-0x000dffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0xdff00000-0xdfffffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0xf0000000-0xfebfffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 7 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 10 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKE configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKE disabled Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKF configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKF disabled Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKG configured for IRQ 11 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKH configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKH disabled Sep 30 07:18:18 localhost kernel: iommu: Default domain type: Translated Sep 30 07:18:18 localhost kernel: iommu: DMA domain TLB invalidation policy: lazy mode Sep 30 07:18:18 localhost kernel: PCI: Using ACPI for IRQ routing Sep 30 07:18:18 localhost kernel: PCI: pci_cache_line_size set to 64 bytes Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0x0009f000-0x0009ffff] Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0xdfe80000-0xdfffffff] Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0x51d000000-0x51fffffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: setting as boot VGA device Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: bridge control possible Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Sep 30 07:18:18 localhost kernel: vgaarb: loaded Sep 30 07:18:18 localhost kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0 Sep 30 07:18:18 localhost kernel: hpet0: 4 comparators, 32-bit 14.318180 MHz counter Sep 30 07:18:18 localhost kernel: clocksource: Switched to clocksource tsc-early Sep 30 07:18:18 localhost kernel: VFS: Disk quotas dquot_6.6.0 Sep 30 07:18:18 localhost kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Sep 30 07:18:18 localhost kernel: pnp: PnP ACPI init Sep 30 07:18:18 localhost kernel: pnp 00:02: [dma 0 disabled] Sep 30 07:18:18 localhost kernel: system 00:03: [mem 0xfec00000-0xfec00fff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:03: [mem 0xfee00000-0xfee00fff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x04d0-0x04d1] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x040b] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x04d6] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c00-0x0c01] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c14] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c50-0x0c51] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c52] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c6c] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c6f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd0-0x0cd1] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd2-0x0cd3] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd4-0x0cd5] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd6-0x0cd7] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd8-0x0cdf] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b00-0x0b3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0800-0x089f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b00-0x0b0f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b20-0x0b3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0900-0x090f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0910-0x091f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0xfe00-0xfefe] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xdff00000-0xdfffffff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xffb80000-0xffbfffff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xfec10000-0xfec1001f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xfed40000-0xfed44fff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0230-0x023f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0290-0x029f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0300-0x030f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0a30-0x0a3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:06: [mem 0xe0000000-0xefffffff] has been reserved Sep 30 07:18:18 localhost kernel: pnp 00:07: disabling [mem 0x000c0000-0x000cffff] because it overlaps 0000:01:05.0 BAR 6 [mem 0x000c0000-0x000dffff] Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x00000000-0x0009ffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x000e0000-0x000fffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x00100000-0xdfefffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0xfec00000-0xffffffff] could not be reserved Sep 30 07:18:18 localhost kernel: pnp: PnP ACPI: found 8 devices Sep 30 07:18:18 localhost kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Sep 30 07:18:18 localhost kernel: NET: Registered PF_INET protocol family Sep 30 07:18:18 localhost kernel: IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) Sep 30 07:18:18 localhost kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP: Hash tables configured (established 262144 bind 65536) Sep 30 07:18:18 localhost kernel: UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Sep 30 07:18:18 localhost kernel: NET: Registered PF_XDP protocol family Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: PCI bridge to [bus 01] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PCI bridge to [bus 02] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: bridge window [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PCI bridge to [bus 03] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: PCI bridge to [bus 04] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 8 [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 9 [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 0 [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 1 [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 2 [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:02: resource 1 [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:03: resource 0 [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:03: resource 2 [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 4 [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 5 [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 6 [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 7 [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 8 [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 9 [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: MSI quirk detected; subordinate MSI disabled Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: D0 power state depends on 0000:01:05.0 Sep 30 07:18:18 localhost kernel: PCI: CLS 64 bytes, default 64 Sep 30 07:18:18 localhost kernel: PCI-DMA: Disabling AGP. Sep 30 07:18:18 localhost kernel: PCI-DMA: aperture base @ d8000000 size 65536 KB Sep 30 07:18:18 localhost kernel: PCI-DMA: using GART IOMMU. Sep 30 07:18:18 localhost kernel: PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture Sep 30 07:18:18 localhost kernel: software IO TLB: tearing down default memory pool Sep 30 07:18:18 localhost kernel: LVT offset 0 assigned for vector 0x400 Sep 30 07:18:18 localhost kernel: perf: AMD IBS detected (0x000000ff) Sep 30 07:18:18 localhost kernel: amd_uncore: 4 amd_nb counters detected Sep 30 07:18:18 localhost kernel: Initialise system trusted keyrings Sep 30 07:18:18 localhost kernel: workingset: timestamp_bits=39 max_order=23 bucket_order=0 Sep 30 07:18:18 localhost kernel: Key type asymmetric registered Sep 30 07:18:18 localhost kernel: Asymmetric key parser 'x509' registered Sep 30 07:18:18 localhost kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) Sep 30 07:18:18 localhost kernel: io scheduler mq-deadline registered Sep 30 07:18:18 localhost kernel: io scheduler kyber registered Sep 30 07:18:18 localhost kernel: io scheduler bfq registered Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P001: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P002: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P003: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P004: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P005: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P006: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P007: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P008: Found 2 idle states Sep 30 07:18:18 localhost kernel: ioatdma: Intel(R) QuickData Technology Driver 5.00 Sep 30 07:18:18 localhost kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Sep 30 07:18:18 localhost kernel: 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Sep 30 07:18:18 localhost kernel: i8042: PNP: No PS/2 controller found. Sep 30 07:18:18 localhost kernel: i8042: Probing ports directly. Sep 30 07:18:18 localhost kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Sep 30 07:18:18 localhost kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: RTC can wake from S4 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: registered as rtc0 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: setting system clock to 2024-09-30T07:18:17 UTC (1727680697) Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Sep 30 07:18:18 localhost kernel: amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled Sep 30 07:18:18 localhost kernel: NET: Registered PF_INET6 protocol family Sep 30 07:18:18 localhost kernel: Segment Routing with IPv6 Sep 30 07:18:18 localhost kernel: In-situ OAM (IOAM) with IPv6 Sep 30 07:18:18 localhost kernel: NET: Registered PF_PACKET protocol family Sep 30 07:18:18 localhost kernel: Key type dns_resolver registered Sep 30 07:18:18 localhost kernel: x86/pm: family 0x15 cpu detected, MSR saving is needed during suspending. Sep 30 07:18:18 localhost kernel: microcode: microcode updated early to new patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU6: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU7: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU1: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU3: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU2: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU4: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU5: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU0: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: Microcode Update Driver: v2.2. Sep 30 07:18:18 localhost kernel: IPI shorthand broadcast: enabled Sep 30 07:18:18 localhost kernel: sched_clock: Marking stable (2619001374, 794683213)->(3696234362, -282549775) Sep 30 07:18:18 localhost kernel: registered taskstats version 1 Sep 30 07:18:18 localhost kernel: Loading compiled-in X.509 certificates Sep 30 07:18:18 localhost kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.6.48-flatcar: a53bb4e7e3319f75620f709d8a6c7aef0adb3b02' Sep 30 07:18:18 localhost kernel: Key type .fscrypt registered Sep 30 07:18:18 localhost kernel: Key type fscrypt-provisioning registered Sep 30 07:18:18 localhost kernel: ima: No TPM chip found, activating TPM-bypass! Sep 30 07:18:18 localhost kernel: ima: Allocated hash algorithm: sha1 Sep 30 07:18:18 localhost kernel: ima: No architecture policies found Sep 30 07:18:18 localhost kernel: clk: Disabling unused clocks Sep 30 07:18:18 localhost kernel: Freeing unused kernel image (initmem) memory: 49336K Sep 30 07:18:18 localhost kernel: Write protecting the kernel read-only data: 36864k Sep 30 07:18:18 localhost kernel: Freeing unused kernel image (rodata/data gap) memory: 1936K Sep 30 07:18:18 localhost kernel: Run /init as init process Sep 30 07:18:18 localhost kernel: with arguments: Sep 30 07:18:18 localhost kernel: /init Sep 30 07:18:18 localhost kernel: with environment: Sep 30 07:18:18 localhost kernel: HOME=/ Sep 30 07:18:18 localhost kernel: TERM=linux Sep 30 07:18:18 localhost kernel: BOOT_IMAGE=/flatcar/vmlinuz-b Sep 30 07:18:18 localhost kernel: biosdevname=0 Sep 30 07:18:18 localhost systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Sep 30 07:18:18 localhost systemd[1]: Detected architecture x86-64. Sep 30 07:18:18 localhost systemd[1]: Running in initrd. Sep 30 07:18:18 localhost systemd[1]: No hostname configured, using default hostname. Sep 30 07:18:18 localhost systemd[1]: Hostname set to . Sep 30 07:18:18 localhost systemd[1]: Initializing machine ID from random generator. Sep 30 07:18:18 localhost systemd[1]: Queued start job for default target initrd.target. Sep 30 07:18:18 localhost systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Sep 30 07:18:18 localhost systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartlabel-ROOT.device - /dev/disk/by-partlabel/ROOT... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c.device - /dev/disk/by-partuuid/e03dd35c-7c2d-4a47-b3fe-27f15780a57c... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Sep 30 07:18:18 localhost systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Sep 30 07:18:18 localhost kernel: tsc: Refined TSC clocksource calibration: 3214.431 MHz Sep 30 07:18:18 localhost kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2e558aca513, max_idle_ns: 440795308132 ns Sep 30 07:18:18 localhost kernel: clocksource: Switched to clocksource tsc Sep 30 07:18:18 localhost systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Sep 30 07:18:18 localhost systemd[1]: Reached target ignition-diskful-subsequent.target - Ignition Subsequent Boot Disk Setup. Sep 30 07:18:18 localhost systemd[1]: Reached target paths.target - Path Units. Sep 30 07:18:18 localhost systemd[1]: Reached target slices.target - Slice Units. Sep 30 07:18:18 localhost systemd[1]: Reached target swap.target - Swaps. Sep 30 07:18:18 localhost systemd[1]: Reached target timers.target - Timer Units. Sep 30 07:18:18 localhost systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-journald.socket - Journal Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Sep 30 07:18:18 localhost systemd[1]: Reached target sockets.target - Socket Units. Sep 30 07:18:18 localhost systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Sep 30 07:18:18 localhost systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-fsck-usr.service... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-journald.service - Journal Service... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:18 localhost systemd-journald[213]: Collecting audit messages is disabled. Sep 30 07:18:18 localhost systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Sep 30 07:18:18 localhost systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-fsck-usr.service. Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Sep 30 07:18:18 localhost systemd-journald[213]: Journal started Sep 30 07:18:18 localhost systemd-journald[213]: Runtime Journal (/run/log/journal/a316c37be01640b1b6e800bb2c3cd8a5) is 8.0M, max 399.0M, 391.0M free. Sep 30 07:18:18 localhost systemd-modules-load[214]: Inserted module 'overlay' Sep 30 07:18:18 localhost systemd[1]: Started systemd-journald.service - Journal Service. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Sep 30 07:18:18 localhost systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup.service - Create Volatile Files and Directories... Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup.service - Create Volatile Files and Directories. Sep 30 07:18:18 localhost kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Sep 30 07:18:18 localhost systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:18 localhost systemd-modules-load[214]: Inserted module 'br_netfilter' Sep 30 07:18:18 localhost kernel: Bridge firewalling registered Sep 30 07:18:18 localhost systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Sep 30 07:18:18 localhost systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Sep 30 07:18:18 localhost systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Sep 30 07:18:18 localhost dracut-cmdline[242]: dracut-dracut-053 Sep 30 07:18:18 localhost systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Sep 30 07:18:18 localhost dracut-cmdline[242]: Using kernel command line parameters: rd.driver.pre=btrfs rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: SCSI subsystem initialized Sep 30 07:18:18 localhost kernel: Loading iSCSI transport class v2.0-870. Sep 30 07:18:18 localhost kernel: iscsi: registered transport (tcp) Sep 30 07:18:18 localhost kernel: iscsi: registered transport (qla4xxx) Sep 30 07:18:18 localhost kernel: QLogic iSCSI HBA Driver Sep 30 07:18:18 localhost kernel: random: crng init done Sep 30 07:18:18 localhost systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Sep 30 07:18:18 localhost systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Sep 30 07:18:18 localhost kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Sep 30 07:18:18 localhost kernel: device-mapper: uevent: version 1.0.3 Sep 30 07:18:18 localhost kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Sep 30 07:18:19 localhost kernel: raid6: sse2x4 gen() 8342 MB/s Sep 30 07:18:19 localhost kernel: raid6: sse2x2 gen() 7120 MB/s Sep 30 07:18:19 localhost kernel: raid6: sse2x1 gen() 5682 MB/s Sep 30 07:18:19 localhost kernel: raid6: using algorithm sse2x4 gen() 8342 MB/s Sep 30 07:18:19 localhost kernel: raid6: .... xor() 3112 MB/s, rmw enabled Sep 30 07:18:19 localhost kernel: raid6: using ssse3x2 recovery algorithm Sep 30 07:18:19 localhost kernel: xor: automatically using best checksumming function avx Sep 30 07:18:19 localhost kernel: Btrfs loaded, zoned=no, fsverity=no Sep 30 07:18:19 localhost systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Sep 30 07:18:19 localhost systemd-udevd[434]: Using default interface naming scheme 'v255'. Sep 30 07:18:19 localhost systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Sep 30 07:18:19 localhost systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Sep 30 07:18:19 localhost dracut-pre-trigger[440]: rd.md=0: removing MD RAID activation Sep 30 07:18:19 localhost systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Sep 30 07:18:19 localhost systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Sep 30 07:18:19 localhost kernel: cryptd: max_cpu_qlen set to 1000 Sep 30 07:18:19 localhost systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Sep 30 07:18:19 localhost systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:19 localhost kernel: ACPI: bus type USB registered Sep 30 07:18:19 localhost systemd[1]: Stopping dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:19 localhost systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Sep 30 07:18:19 localhost systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:19 localhost systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:19 localhost kernel: usbcore: registered new interface driver usbfs Sep 30 07:18:19 localhost kernel: usbcore: registered new interface driver hub Sep 30 07:18:19 localhost kernel: usbcore: registered new device driver usb Sep 30 07:18:19 localhost kernel: libata version 3.00 loaded. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:19 localhost kernel: AVX version of gcm_enc/dec engaged. Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: EHCI Host Controller Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: new USB bus registered, assigned bus number 1 Sep 30 07:18:19 localhost kernel: AES CTR mode by8 optimization enabled Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: applying AMD SB700/SB800/Hudson-2/3 EHCI dummy qh workaround Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: debug port 1 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: irq 17, io mem 0xfe8ff800 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: USB 2.0 started, EHCI 1.00 Sep 30 07:18:19 localhost kernel: hub 1-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: hub 1-0:1.0: 6 ports detected Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: EHCI Host Controller Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: new USB bus registered, assigned bus number 2 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: applying AMD SB700/SB800/Hudson-2/3 EHCI dummy qh workaround Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: debug port 1 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: irq 19, io mem 0xfe8ff400 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: USB 2.0 started, EHCI 1.00 Sep 30 07:18:19 localhost systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:19 localhost kernel: hub 2-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: hub 2-0:1.0: 6 ports detected Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: OHCI PCI host controller Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: new USB bus registered, assigned bus number 3 Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: irq 16, io mem 0xfe8fe000 Sep 30 07:18:19 localhost systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:19 localhost kernel: xhci_hcd 0000:02:00.0: xHCI Host Controller Sep 30 07:18:19 localhost kernel: xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 4 Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: version 3.0 Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: AHCI 0001.0100 32 slots 6 ports 3 Gbps 0x3f impl SATA mode Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: flags: 64bit ncq sntf ilck pm led clo pmp pio slum part ccc Sep 30 07:18:19 localhost kernel: scsi host0: ahci Sep 30 07:18:19 localhost kernel: r8169 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control Sep 30 07:18:19 localhost kernel: scsi host1: ahci Sep 30 07:18:19 localhost kernel: hub 3-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: scsi host2: ahci Sep 30 07:18:19 localhost kernel: hub 3-0:1.0: 3 ports detected Sep 30 07:18:19 localhost kernel: scsi host3: ahci Sep 30 07:18:19 localhost kernel: scsi host4: ahci Sep 30 07:18:19 localhost systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.1: OHCI PCI host controller Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.1: new USB bus registered, assigned bus number 5 Sep 30 07:18:19 localhost kernel: scsi host5: ahci Sep 30 07:18:19 localhost kernel: ata1: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffd00 irq 22 Sep 30 07:18:19 localhost kernel: ata2: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffd80 irq 22 Sep 30 07:18:19 localhost kernel: ata3: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffe00 irq 22 Sep 30 07:18:19 localhost kernel: ata4: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffe80 irq 22 Sep 30 07:18:19 localhost kernel: ata5: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8fff00 irq 22 Sep 30 07:18:19 localhost kernel: ata6: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8fff80 irq 22 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: hcc params 0x0200e080 hci version 0x100 quirks 0x0000000010800410 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:12.1: irq 16, io mem 0xfe8fd000 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: xHCI Host Controller Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 6 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: Host supports USB 3.0 SuperSpeed Sep 30 07:18:20 localhost kernel: hub 4-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 4-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: r8169 0000:03:00.0 eth0: RTL8168f/8111f, f0:79:59:5f:d1:4c, XID 480, IRQ 26 Sep 30 07:18:20 localhost kernel: r8169 0000:03:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko] Sep 30 07:18:20 localhost kernel: usb usb6: We don't know the algorithms for LPM for this host, disabling LPM. Sep 30 07:18:20 localhost kernel: hub 6-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 6-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: hub 5-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 5-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: new USB bus registered, assigned bus number 7 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: irq 18, io mem 0xfe8fc000 Sep 30 07:18:20 localhost kernel: hub 7-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 7-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: new USB bus registered, assigned bus number 8 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: irq 18, io mem 0xfe8fb000 Sep 30 07:18:20 localhost kernel: hub 8-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 8-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: new USB bus registered, assigned bus number 9 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: irq 18, io mem 0xfe8fa000 Sep 30 07:18:20 localhost kernel: ata5: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata6: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata2: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata4: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: hub 9-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 9-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Sep 30 07:18:20 localhost kernel: ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Sep 30 07:18:20 localhost kernel: ata1.00: ATA-9: WDC WD5003AZEX-00MK2A0, 01.01A01, max UDMA/133 Sep 30 07:18:20 localhost kernel: ata3.00: ATA-11: SPCC Solid State Disk, SBFM61.3, max UDMA/133 Sep 30 07:18:20 localhost kernel: ata1.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 32), AA Sep 30 07:18:20 localhost kernel: ata3.00: 1000215216 sectors, multi 16: LBA48 NCQ (depth 32), AA Sep 30 07:18:20 localhost kernel: ata1.00: configured for UDMA/133 Sep 30 07:18:20 localhost kernel: scsi 0:0:0:0: Direct-Access ATA WDC WD5003AZEX-0 1A01 PQ: 0 ANSI: 5 Sep 30 07:18:20 localhost kernel: ata3.00: configured for UDMA/133 Sep 30 07:18:20 localhost kernel: scsi 2:0:0:0: Direct-Access ATA SPCC Solid State 61.3 PQ: 0 ANSI: 5 Sep 30 07:18:20 localhost (udev-worker)[497]: Network interface NamePolicy= disabled on kernel command line. Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] 1000215216 512-byte logical blocks: (512 GB/477 GiB) Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB) Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] 4096-byte physical blocks Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Write Protect is off Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Write Protect is off Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00 Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Preferred minimum I/O size 512 bytes Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Attached SCSI disk Sep 30 07:18:20 localhost kernel: sda: sda1 sda2 sda3 sda4 sda6 sda7 sda9 Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Attached SCSI disk Sep 30 07:18:20 localhost kernel: BTRFS: device label OEM devid 1 transid 36 /dev/sda6 scanned by (udev-worker) (492) Sep 30 07:18:20 localhost kernel: BTRFS: device fsid d3844c60-0a2c-449a-9ee9-2a875f8d8e12 devid 1 transid 36 /dev/sda3 scanned by (udev-worker) (508) Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - WDC_WD5003AZEX-00MK2A0 OEM. Sep 30 07:18:21 localhost kernel: BTRFS: device fsid d110be6f-93a3-451a-b365-11b5d04e0602 devid 1 transid 33 /dev/sda4 scanned by (udev-worker) (509) Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - WDC_WD5003AZEX-00MK2A0 USR-A. Sep 30 07:18:21 localhost systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c.device - WDC_WD5003AZEX-00MK2A0 USR-B. Sep 30 07:18:21 localhost systemd[1]: disk-uuid.service: Deactivated successfully. Sep 30 07:18:21 localhost systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Sep 30 07:18:21 localhost systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target local-fs.target - Local File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target sysinit.target - System Initialization. Sep 30 07:18:21 localhost systemd[1]: Reached target basic.target - Basic System. Sep 30 07:18:21 localhost systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - WDC_WD5003AZEX-00MK2A0 ROOT. Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartlabel-ROOT.device - WDC_WD5003AZEX-00MK2A0 ROOT. Sep 30 07:18:21 localhost systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Sep 30 07:18:21 localhost sh[605]: Success Sep 30 07:18:21 localhost systemd[1]: Starting decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition... Sep 30 07:18:21 localhost systemd[1]: Finished decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition. Sep 30 07:18:21 localhost systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Sep 30 07:18:21 localhost kernel: device-mapper: verity: sha256 using implementation "sha256-avx" Sep 30 07:18:21 localhost systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-fs.target - Remote File Systems. Sep 30 07:18:21 localhost systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Sep 30 07:18:21 localhost systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Sep 30 07:18:21 localhost systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Sep 30 07:18:21 localhost systemd-fsck[637]: ROOT: clean, 62030/120732480 files, 9218165/121489409 blocks Sep 30 07:18:21 localhost systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot.mount - /sysroot... Sep 30 07:18:21 localhost systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Sep 30 07:18:21 localhost systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Sep 30 07:18:21 localhost systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): first mount of filesystem d110be6f-93a3-451a-b365-11b5d04e0602 Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): using crc32c (crc32c-intel) checksum algorithm Sep 30 07:18:21 localhost kernel: BTRFS warning (device dm-0): 'nologreplay' is deprecated, use 'rescue=nologreplay' instead Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): disabling log replay at mount time Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): using free space tree Sep 30 07:18:21 localhost kernel: EXT4-fs (sda9): mounted filesystem e865ac73-053b-4efa-9a0f-50dec3f650d9 r/w with ordered data mode. Quota mode: none. Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot.mount - /sysroot. Sep 30 07:18:21 localhost systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Sep 30 07:18:21 localhost systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Sep 30 07:18:21 localhost systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): first mount of filesystem b6695624-d538-4f05-9ddd-23ee987404c1 Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): using crc32c (crc32c-intel) checksum algorithm Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): using free space tree Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[985]: grep: /sysroot/oem/oem-release: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[987]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[987]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[991]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Sep 30 07:18:22 localhost systemd[1]: Reached target ignition-subsequent.target - Subsequent (Not Ignition) boot complete. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Sep 30 07:18:22 localhost systemd[1]: initrd-parse-etc.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd.target - Initrd Default Target. Sep 30 07:18:22 localhost systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Sep 30 07:18:22 localhost systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Sep 30 07:18:22 localhost systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Sep 30 07:18:22 localhost systemd[1]: Stopped target timers.target - Timer Units. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Sep 30 07:18:22 localhost systemd[1]: Stopped target initrd.target - Initrd Default Target. Sep 30 07:18:22 localhost systemd[1]: Stopped target basic.target - Basic System. Sep 30 07:18:22 localhost systemd[1]: Stopped target ignition-subsequent.target - Subsequent (Not Ignition) boot complete. Sep 30 07:18:22 localhost systemd[1]: Stopped target ignition-diskful-subsequent.target - Ignition Subsequent Boot Disk Setup. Sep 30 07:18:22 localhost systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Sep 30 07:18:22 localhost systemd[1]: Stopped target paths.target - Path Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-fs.target - Remote File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target slices.target - Slice Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target sockets.target - Socket Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target sysinit.target - System Initialization. Sep 30 07:18:22 localhost systemd[1]: Stopped target local-fs.target - Local File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target swap.target - Swaps. Sep 30 07:18:22 localhost systemd[1]: iscsid.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Sep 30 07:18:22 localhost systemd[1]: iscsiuio.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-mount.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Sep 30 07:18:22 localhost systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Sep 30 07:18:22 localhost systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Sep 30 07:18:22 localhost systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Sep 30 07:18:22 localhost systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Sep 30 07:18:22 localhost systemd[1]: dracut-initqueue.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Sep 30 07:18:22 localhost systemd[1]: decrypt-root.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition. Sep 30 07:18:22 localhost systemd[1]: ignition-setup-pre.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Sep 30 07:18:22 localhost systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Sep 30 07:18:22 localhost systemd[1]: initrd-setup-root.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Sep 30 07:18:22 localhost systemd[1]: kmod-static-nodes.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Sep 30 07:18:22 localhost systemd[1]: systemd-sysctl.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Sep 30 07:18:22 localhost systemd[1]: systemd-modules-load.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Sep 30 07:18:22 localhost systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-tmpfiles-setup.service - Create Volatile Files and Directories. Sep 30 07:18:22 localhost systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Sep 30 07:18:22 localhost systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Sep 30 07:18:22 localhost systemd[1]: initrd-cleanup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-udev.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Sep 30 07:18:22 localhost systemd[1]: dracut-cmdline.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Sep 30 07:18:22 localhost systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Sep 30 07:18:22 localhost systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Sep 30 07:18:22 localhost systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:22 localhost systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd-switch-root.target - Switch Root. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-switch-root.service - Switch Root... Sep 30 07:18:22 localhost systemd[1]: Switching root. Sep 30 07:18:22 localhost systemd-journald[213]: Journal stopped Sep 30 07:18:18 localhost kernel: Linux version 6.6.48-flatcar (build@pony-truck.infra.kinvolk.io) (x86_64-cros-linux-gnu-gcc (Gentoo Hardened 13.2.1_p20240210 p14) 13.2.1 20240210, GNU ld (Gentoo 2.41 p5) 2.41.0) #1 SMP PREEMPT_DYNAMIC Wed Sep 4 15:49:08 -00 2024 Sep 30 07:18:18 localhost kernel: Command line: BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: BIOS-provided physical RAM map: Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009efff] usable Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x000000000009f000-0x000000000009ffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000000e4000-0x00000000000fffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000dfe7ffff] usable Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfe80000-0x00000000dfe97fff] ACPI data Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfe98000-0x00000000dfebffff] ACPI NVS Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000dfec0000-0x00000000dfefffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved Sep 30 07:18:18 localhost kernel: BIOS-e820: [mem 0x0000000100000000-0x000000051cffffff] usable Sep 30 07:18:18 localhost kernel: NX (Execute Disable) protection: active Sep 30 07:18:18 localhost kernel: APIC: Static calls initialized Sep 30 07:18:18 localhost kernel: SMBIOS 2.5 present. Sep 30 07:18:18 localhost kernel: DMI: System manufacturer System Product Name/M5A78L-M/USB3, BIOS 2101 12/02/2014 Sep 30 07:18:18 localhost kernel: tsc: Fast TSC calibration using PIT Sep 30 07:18:18 localhost kernel: tsc: Detected 3214.344 MHz processor Sep 30 07:18:18 localhost kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Sep 30 07:18:18 localhost kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Sep 30 07:18:18 localhost kernel: AGP: No AGP bridge found Sep 30 07:18:18 localhost kernel: last_pfn = 0x51d000 max_arch_pfn = 0x400000000 Sep 30 07:18:18 localhost kernel: MTRR map: 5 entries (3 fixed + 2 variable; max 20), built from 9 variable MTRRs Sep 30 07:18:18 localhost kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Sep 30 07:18:18 localhost kernel: e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved Sep 30 07:18:18 localhost kernel: last_pfn = 0xdfe80 max_arch_pfn = 0x400000000 Sep 30 07:18:18 localhost kernel: Using GB pages for direct mapping Sep 30 07:18:18 localhost kernel: ACPI: Early table checksum verification disabled Sep 30 07:18:18 localhost kernel: ACPI: RSDP 0x00000000000FB490 000024 (v02 ACPIAM) Sep 30 07:18:18 localhost kernel: ACPI: XSDT 0x00000000DFE80100 000054 (v01 120214 XSDT0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: FACP 0x00000000DFE80290 0000F4 (v03 120214 FACP0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20230628/tbfadt-615) Sep 30 07:18:18 localhost kernel: ACPI BIOS Warning (bug): 32/64X length mismatch in FADT/Gpe0Block: 64/32 (20230628/tbfadt-564) Sep 30 07:18:18 localhost kernel: ACPI: DSDT 0x00000000DFE80460 00DBCE (v01 A1887 A1887001 00000001 INTL 20060113) Sep 30 07:18:18 localhost kernel: ACPI: FACS 0x00000000DFE98000 000040 Sep 30 07:18:18 localhost kernel: ACPI: FACS 0x00000000DFE98000 000040 Sep 30 07:18:18 localhost kernel: ACPI: APIC 0x00000000DFE80390 00008C (v01 120214 APIC0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: MCFG 0x00000000DFE80420 00003C (v01 120214 OEMMCFG 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: OEMB 0x00000000DFE98040 000072 (v01 120214 OEMB0955 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: HPET 0x00000000DFE8F460 000038 (v01 120214 OEMHPET 20141202 MSFT 00000097) Sep 30 07:18:18 localhost kernel: ACPI: SSDT 0x00000000DFE8F4A0 001714 (v01 A M I POWERNOW 00000001 AMD 00000001) Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACP table memory at [mem 0xdfe80290-0xdfe80383] Sep 30 07:18:18 localhost kernel: ACPI: Reserving DSDT table memory at [mem 0xdfe80460-0xdfe8e02d] Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACS table memory at [mem 0xdfe98000-0xdfe9803f] Sep 30 07:18:18 localhost kernel: ACPI: Reserving FACS table memory at [mem 0xdfe98000-0xdfe9803f] Sep 30 07:18:18 localhost kernel: ACPI: Reserving APIC table memory at [mem 0xdfe80390-0xdfe8041b] Sep 30 07:18:18 localhost kernel: ACPI: Reserving MCFG table memory at [mem 0xdfe80420-0xdfe8045b] Sep 30 07:18:18 localhost kernel: ACPI: Reserving OEMB table memory at [mem 0xdfe98040-0xdfe980b1] Sep 30 07:18:18 localhost kernel: ACPI: Reserving HPET table memory at [mem 0xdfe8f460-0xdfe8f497] Sep 30 07:18:18 localhost kernel: ACPI: Reserving SSDT table memory at [mem 0xdfe8f4a0-0xdfe90bb3] Sep 30 07:18:18 localhost kernel: No NUMA configuration found Sep 30 07:18:18 localhost kernel: Faking a node at [mem 0x0000000000000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: NODE_DATA(0) allocated [mem 0x51cffa000-0x51cffffff] Sep 30 07:18:18 localhost kernel: Zone ranges: Sep 30 07:18:18 localhost kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Sep 30 07:18:18 localhost kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Sep 30 07:18:18 localhost kernel: Normal [mem 0x0000000100000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: Movable zone start for each node Sep 30 07:18:18 localhost kernel: Early memory node ranges Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000000100000-0x00000000dfe7ffff] Sep 30 07:18:18 localhost kernel: node 0: [mem 0x0000000100000000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000051cffffff] Sep 30 07:18:18 localhost kernel: On node 0, zone DMA: 1 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone DMA: 97 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone Normal: 384 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: On node 0, zone Normal: 12288 pages in unavailable ranges Sep 30 07:18:18 localhost kernel: ACPI: PM-Timer IO Port: 0x808 Sep 30 07:18:18 localhost kernel: IOAPIC[0]: apic_id 24, version 33, address 0xfec00000, GSI 0-23 Sep 30 07:18:18 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Sep 30 07:18:18 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) Sep 30 07:18:18 localhost kernel: ACPI: Using ACPI (MADT) for SMP configuration information Sep 30 07:18:18 localhost kernel: ACPI: HPET id: 0x8300 base: 0xfed00000 Sep 30 07:18:18 localhost kernel: smpboot: Allowing 8 CPUs, 0 hotplug CPUs Sep 30 07:18:18 localhost kernel: [mem 0xdff00000-0xffdfffff] available for PCI devices Sep 30 07:18:18 localhost kernel: Booting paravirtualized kernel on bare hardware Sep 30 07:18:18 localhost kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Sep 30 07:18:18 localhost kernel: setup_percpu: NR_CPUS:512 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 Sep 30 07:18:18 localhost kernel: percpu: Embedded 58 pages/cpu s196904 r8192 d32472 u262144 Sep 30 07:18:18 localhost kernel: pcpu-alloc: s196904 r8192 d32472 u262144 alloc=1*2097152 Sep 30 07:18:18 localhost kernel: pcpu-alloc: [0] 0 1 2 3 4 5 6 7 Sep 30 07:18:18 localhost kernel: Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-b biosdevname=0", will be passed to user space. Sep 30 07:18:18 localhost kernel: Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Sep 30 07:18:18 localhost kernel: Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) Sep 30 07:18:18 localhost kernel: Fallback order for Node 0: 0 Sep 30 07:18:18 localhost kernel: Built 1 zonelists, mobility grouping on. Total pages: 5148230 Sep 30 07:18:18 localhost kernel: Policy zone: Normal Sep 30 07:18:18 localhost kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Sep 30 07:18:18 localhost kernel: AGP: Checking aperture... Sep 30 07:18:18 localhost kernel: AGP: No AGP bridge found Sep 30 07:18:18 localhost kernel: AGP: Node 0: aperture [bus addr 0x00000000-0x01ffffff] (32MB) Sep 30 07:18:18 localhost kernel: AGP: Your BIOS doesn't leave an aperture memory hole Sep 30 07:18:18 localhost kernel: AGP: Please enable the IOMMU option in the BIOS setup Sep 30 07:18:18 localhost kernel: AGP: This costs you 64MB of RAM Sep 30 07:18:18 localhost kernel: AGP: Mapping aperture over RAM [mem 0xd8000000-0xdbffffff] (65536KB) Sep 30 07:18:18 localhost kernel: software IO TLB: area num 8. Sep 30 07:18:18 localhost kernel: Memory: 20314604K/20920440K available (12288K kernel code, 2303K rwdata, 22640K rodata, 49336K init, 2008K bss, 605576K reserved, 0K cma-reserved) Sep 30 07:18:18 localhost kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 Sep 30 07:18:18 localhost kernel: ftrace: allocating 37670 entries in 148 pages Sep 30 07:18:18 localhost kernel: ftrace: allocated 148 pages with 3 groups Sep 30 07:18:18 localhost kernel: Dynamic Preempt: voluntary Sep 30 07:18:18 localhost kernel: rcu: Preemptible hierarchical RCU implementation. Sep 30 07:18:18 localhost kernel: rcu: RCU event tracing is enabled. Sep 30 07:18:18 localhost kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=8. Sep 30 07:18:18 localhost kernel: Trampoline variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: Rude variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: Tracing variant of Tasks RCU enabled. Sep 30 07:18:18 localhost kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Sep 30 07:18:18 localhost kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 Sep 30 07:18:18 localhost kernel: NR_IRQS: 33024, nr_irqs: 488, preallocated irqs: 16 Sep 30 07:18:18 localhost kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Sep 30 07:18:18 localhost kernel: spurious 8259A interrupt: IRQ7. Sep 30 07:18:18 localhost kernel: Console: colour VGA+ 80x25 Sep 30 07:18:18 localhost kernel: printk: console [tty0] enabled Sep 30 07:18:18 localhost kernel: printk: console [ttyS0] enabled Sep 30 07:18:18 localhost kernel: ACPI: Core revision 20230628 Sep 30 07:18:18 localhost kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns Sep 30 07:18:18 localhost kernel: APIC: Switch to symmetric I/O mode setup Sep 30 07:18:18 localhost kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Sep 30 07:18:18 localhost kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2e5537fab7e, max_idle_ns: 440795243159 ns Sep 30 07:18:18 localhost kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 6428.68 BogoMIPS (lpj=3214344) Sep 30 07:18:18 localhost kernel: LVT offset 1 assigned for vector 0xf9 Sep 30 07:18:18 localhost kernel: Last level iTLB entries: 4KB 512, 2MB 1024, 4MB 512 Sep 30 07:18:18 localhost kernel: Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 512, 1GB 0 Sep 30 07:18:18 localhost kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Sep 30 07:18:18 localhost kernel: Spectre V2 : Mitigation: Retpolines Sep 30 07:18:18 localhost kernel: Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Sep 30 07:18:18 localhost kernel: Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Sep 30 07:18:18 localhost kernel: Spectre V2 : Enabling Speculation Barrier for firmware calls Sep 30 07:18:18 localhost kernel: RETBleed: Mitigation: untrained return thunk Sep 30 07:18:18 localhost kernel: Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Sep 30 07:18:18 localhost kernel: Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Sep 30 07:18:18 localhost kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Sep 30 07:18:18 localhost kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Sep 30 07:18:18 localhost kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Sep 30 07:18:18 localhost kernel: Freeing SMP alternatives memory: 32K Sep 30 07:18:18 localhost kernel: pid_max: default: 32768 minimum: 301 Sep 30 07:18:18 localhost kernel: LSM: initializing lsm=lockdown,capability,selinux,integrity Sep 30 07:18:18 localhost kernel: SELinux: Initializing. Sep 30 07:18:18 localhost kernel: Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: smpboot: CPU0: AMD FX-8320E Eight-Core Processor (family: 0x15, model: 0x2, stepping: 0x0) Sep 30 07:18:18 localhost kernel: RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. Sep 30 07:18:18 localhost kernel: Performance Events: Fam15h core perfctr, AMD PMU driver. Sep 30 07:18:18 localhost kernel: ... version: 0 Sep 30 07:18:18 localhost kernel: ... bit width: 48 Sep 30 07:18:18 localhost kernel: ... generic registers: 6 Sep 30 07:18:18 localhost kernel: ... value mask: 0000ffffffffffff Sep 30 07:18:18 localhost kernel: ... max period: 00007fffffffffff Sep 30 07:18:18 localhost kernel: ... fixed-purpose events: 0 Sep 30 07:18:18 localhost kernel: ... event mask: 000000000000003f Sep 30 07:18:18 localhost kernel: signal: max sigframe size: 1776 Sep 30 07:18:18 localhost kernel: rcu: Hierarchical SRCU implementation. Sep 30 07:18:18 localhost kernel: rcu: Max phase no-delay instances is 400. Sep 30 07:18:18 localhost kernel: NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. Sep 30 07:18:18 localhost kernel: smp: Bringing up secondary CPUs ... Sep 30 07:18:18 localhost kernel: smpboot: x86: Booting SMP configuration: Sep 30 07:18:18 localhost kernel: .... node #0, CPUs: #2 #4 #6 #1 #3 #5 #7 Sep 30 07:18:18 localhost kernel: smp: Brought up 1 node, 8 CPUs Sep 30 07:18:18 localhost kernel: smpboot: Max logical packages: 1 Sep 30 07:18:18 localhost kernel: smpboot: Total of 8 processors activated (51429.50 BogoMIPS) Sep 30 07:18:18 localhost kernel: devtmpfs: initialized Sep 30 07:18:18 localhost kernel: x86/mm: Memory block size: 128MB Sep 30 07:18:18 localhost kernel: ACPI: PM: Registering ACPI NVS region [mem 0xdfe98000-0xdfebffff] (163840 bytes) Sep 30 07:18:18 localhost kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Sep 30 07:18:18 localhost kernel: futex hash table entries: 2048 (order: 5, 131072 bytes, linear) Sep 30 07:18:18 localhost kernel: pinctrl core: initialized pinctrl subsystem Sep 30 07:18:18 localhost kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Sep 30 07:18:18 localhost kernel: audit: initializing netlink subsys (disabled) Sep 30 07:18:18 localhost kernel: audit: type=2000 audit(1727680694.257:1): state=initialized audit_enabled=0 res=1 Sep 30 07:18:18 localhost kernel: thermal_sys: Registered thermal governor 'step_wise' Sep 30 07:18:18 localhost kernel: thermal_sys: Registered thermal governor 'user_space' Sep 30 07:18:18 localhost kernel: cpuidle: using governor menu Sep 30 07:18:18 localhost kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Sep 30 07:18:18 localhost kernel: dca service started, version 1.12.1 Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) Sep 30 07:18:18 localhost kernel: PCI: not using MMCONFIG Sep 30 07:18:18 localhost kernel: PCI: Using configuration type 1 for base access Sep 30 07:18:18 localhost kernel: PCI: Using configuration type 1 for extended access Sep 30 07:18:18 localhost kernel: kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Sep 30 07:18:18 localhost kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Sep 30 07:18:18 localhost kernel: HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page Sep 30 07:18:18 localhost kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Sep 30 07:18:18 localhost kernel: HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Module Device) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Processor Device) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Sep 30 07:18:18 localhost kernel: ACPI: Added _OSI(Processor Aggregator Device) Sep 30 07:18:18 localhost kernel: ACPI: 2 ACPI AML tables successfully acquired and loaded Sep 30 07:18:18 localhost kernel: ACPI: _OSC evaluation for CPUs failed, trying _PDC Sep 30 07:18:18 localhost kernel: ACPI: Interpreter enabled Sep 30 07:18:18 localhost kernel: ACPI: PM: (supports S0 S1 S3 S5) Sep 30 07:18:18 localhost kernel: ACPI: Using IOAPIC for interrupt routing Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000) Sep 30 07:18:18 localhost kernel: PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved as ACPI motherboard resource Sep 30 07:18:18 localhost kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Sep 30 07:18:18 localhost kernel: PCI: Using E820 reservations for host bridge windows Sep 30 07:18:18 localhost kernel: ACPI: Enabled 7 GPEs in block 00 to 1F Sep 30 07:18:18 localhost kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Sep 30 07:18:18 localhost kernel: acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Sep 30 07:18:18 localhost kernel: PCI host bridge to bus 0000:00 Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:00.0: [1022:9600] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: [1043:9602] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: [1022:9607] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: enabling Extended Tags Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PME# supported from D0 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: [1022:9609] type 01 class 0x060400 Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: enabling Extended Tags Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: [1002:4391] type 00 class 0x010601 Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x10: [io 0xc000-0xc007] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x14: [io 0xb000-0xb003] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x18: [io 0xa000-0xa007] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x1c: [io 0x9000-0x9003] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x20: [io 0x8000-0x800f] Sep 30 07:18:18 localhost kernel: pci 0000:00:11.0: reg 0x24: [mem 0xfe8ffc00-0xfe8fffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.0: [1002:4397] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.0: reg 0x10: [mem 0xfe8fe000-0xfe8fefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.1: [1002:4398] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.1: reg 0x10: [mem 0xfe8fd000-0xfe8fdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: [1002:4396] type 00 class 0x0c0320 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: reg 0x10: [mem 0xfe8ff800-0xfe8ff8ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:12.2: PME# supported from D0 D1 D2 D3hot Sep 30 07:18:18 localhost kernel: pci 0000:00:13.0: [1002:4397] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.0: reg 0x10: [mem 0xfe8fc000-0xfe8fcfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.1: [1002:4398] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.1: reg 0x10: [mem 0xfe8fb000-0xfe8fbfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: [1002:4396] type 00 class 0x0c0320 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: reg 0x10: [mem 0xfe8ff400-0xfe8ff4ff] Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:13.2: PME# supported from D0 D1 D2 D3hot Sep 30 07:18:18 localhost kernel: pci 0000:00:14.0: [1002:4385] type 00 class 0x0c0500 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: [1002:439c] type 00 class 0x01018a Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x10: [io 0x0000-0x0007] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x14: [io 0x0000-0x0003] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x18: [io 0x0000-0x0007] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x1c: [io 0x0000-0x0003] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: reg 0x20: [io 0xff00-0xff0f] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.3: [1002:439d] type 00 class 0x060100 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: [1002:4384] type 01 class 0x060401 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.5: [1002:4399] type 00 class 0x0c0310 Sep 30 07:18:18 localhost kernel: pci 0000:00:14.5: reg 0x10: [mem 0xfe8fa000-0xfe8fafff] Sep 30 07:18:18 localhost kernel: pci 0000:00:18.0: [1022:1600] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.1: [1022:1601] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.2: [1022:1602] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.3: [1022:1603] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.4: [1022:1604] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci 0000:00:18.5: [1022:1605] type 00 class 0x060000 Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: extended config space not accessible Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: [1002:9616] type 00 class 0x030000 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x10: [mem 0xfa000000-0xfbffffff pref] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x14: [io 0xd000-0xd0ff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x18: [mem 0xfeaf0000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: reg 0x24: [mem 0xfe900000-0xfe9fffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: [1002:960f] type 00 class 0x040300 Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: reg 0x10: [mem 0xfeae8000-0xfeaebfff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: PCI bridge to [bus 01] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: [1b21:1142] type 00 class 0x0c0330 Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: reg 0x10: [mem 0xfebf0000-0xfebf7fff 64bit] Sep 30 07:18:18 localhost kernel: pci 0000:02:00.0: PME# supported from D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PCI bridge to [bus 02] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: bridge window [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: [10ec:8168] type 00 class 0x020000 Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x10: [io 0xe800-0xe8ff] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x18: [mem 0xfdfff000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: reg 0x20: [mem 0xfdff8000-0xfdffbfff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: supports D1 D2 Sep 30 07:18:18 localhost kernel: pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot D3cold Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PCI bridge to [bus 03] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: extended config space not accessible Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: PCI bridge to [bus 04] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [io 0x0000-0x0cf7 window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [io 0x0d00-0xffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0x000d0000-0x000dffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0xdff00000-0xdfffffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: bridge window [mem 0xf0000000-0xfebfffff window] (subtractive decode) Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 7 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 10 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKE configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKE disabled Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKF configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKF disabled Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKG configured for IRQ 11 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKH configured for IRQ 0 Sep 30 07:18:18 localhost kernel: ACPI: PCI: Interrupt link LNKH disabled Sep 30 07:18:18 localhost kernel: iommu: Default domain type: Translated Sep 30 07:18:18 localhost kernel: iommu: DMA domain TLB invalidation policy: lazy mode Sep 30 07:18:18 localhost kernel: PCI: Using ACPI for IRQ routing Sep 30 07:18:18 localhost kernel: PCI: pci_cache_line_size set to 64 bytes Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0x0009f000-0x0009ffff] Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0xdfe80000-0xdfffffff] Sep 30 07:18:18 localhost kernel: e820: reserve RAM buffer [mem 0x51d000000-0x51fffffff] Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: setting as boot VGA device Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: bridge control possible Sep 30 07:18:18 localhost kernel: pci 0000:01:05.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Sep 30 07:18:18 localhost kernel: vgaarb: loaded Sep 30 07:18:18 localhost kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0 Sep 30 07:18:18 localhost kernel: hpet0: 4 comparators, 32-bit 14.318180 MHz counter Sep 30 07:18:18 localhost kernel: clocksource: Switched to clocksource tsc-early Sep 30 07:18:18 localhost kernel: VFS: Disk quotas dquot_6.6.0 Sep 30 07:18:18 localhost kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Sep 30 07:18:18 localhost kernel: pnp: PnP ACPI init Sep 30 07:18:18 localhost kernel: pnp 00:02: [dma 0 disabled] Sep 30 07:18:18 localhost kernel: system 00:03: [mem 0xfec00000-0xfec00fff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:03: [mem 0xfee00000-0xfee00fff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x04d0-0x04d1] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x040b] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x04d6] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c00-0x0c01] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c14] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c50-0x0c51] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c52] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c6c] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0c6f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd0-0x0cd1] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd2-0x0cd3] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd4-0x0cd5] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd6-0x0cd7] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0cd8-0x0cdf] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b00-0x0b3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0800-0x089f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b00-0x0b0f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0b20-0x0b3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0900-0x090f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0x0910-0x091f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [io 0xfe00-0xfefe] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xdff00000-0xdfffffff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xffb80000-0xffbfffff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xfec10000-0xfec1001f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:04: [mem 0xfed40000-0xfed44fff] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0230-0x023f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0290-0x029f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0300-0x030f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:05: [io 0x0a30-0x0a3f] has been reserved Sep 30 07:18:18 localhost kernel: system 00:06: [mem 0xe0000000-0xefffffff] has been reserved Sep 30 07:18:18 localhost kernel: pnp 00:07: disabling [mem 0x000c0000-0x000cffff] because it overlaps 0000:01:05.0 BAR 6 [mem 0x000c0000-0x000dffff] Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x00000000-0x0009ffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x000e0000-0x000fffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0x00100000-0xdfefffff] could not be reserved Sep 30 07:18:18 localhost kernel: system 00:07: [mem 0xfec00000-0xffffffff] could not be reserved Sep 30 07:18:18 localhost kernel: pnp: PnP ACPI: found 8 devices Sep 30 07:18:18 localhost kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Sep 30 07:18:18 localhost kernel: NET: Registered PF_INET protocol family Sep 30 07:18:18 localhost kernel: IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) Sep 30 07:18:18 localhost kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) Sep 30 07:18:18 localhost kernel: TCP: Hash tables configured (established 262144 bind 65536) Sep 30 07:18:18 localhost kernel: UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) Sep 30 07:18:18 localhost kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Sep 30 07:18:18 localhost kernel: NET: Registered PF_XDP protocol family Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: PCI bridge to [bus 01] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: bridge window [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: PCI bridge to [bus 02] Sep 30 07:18:18 localhost kernel: pci 0000:00:07.0: bridge window [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: PCI bridge to [bus 03] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci 0000:00:0a.0: bridge window [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci 0000:00:14.4: PCI bridge to [bus 04] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 8 [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:00: resource 9 [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 0 [io 0xd000-0xdfff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 1 [mem 0xfe900000-0xfeafffff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:01: resource 2 [mem 0xfa000000-0xfbffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:02: resource 1 [mem 0xfeb00000-0xfebfffff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:03: resource 0 [io 0xe000-0xefff] Sep 30 07:18:18 localhost kernel: pci_bus 0000:03: resource 2 [mem 0xfdf00000-0xfdffffff 64bit pref] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 4 [io 0x0000-0x0cf7 window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 5 [io 0x0d00-0xffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 6 [mem 0x000a0000-0x000bffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 7 [mem 0x000d0000-0x000dffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 8 [mem 0xdff00000-0xdfffffff window] Sep 30 07:18:18 localhost kernel: pci_bus 0000:04: resource 9 [mem 0xf0000000-0xfebfffff window] Sep 30 07:18:18 localhost kernel: pci 0000:00:01.0: MSI quirk detected; subordinate MSI disabled Sep 30 07:18:18 localhost kernel: pci 0000:01:05.1: D0 power state depends on 0000:01:05.0 Sep 30 07:18:18 localhost kernel: PCI: CLS 64 bytes, default 64 Sep 30 07:18:18 localhost kernel: PCI-DMA: Disabling AGP. Sep 30 07:18:18 localhost kernel: PCI-DMA: aperture base @ d8000000 size 65536 KB Sep 30 07:18:18 localhost kernel: PCI-DMA: using GART IOMMU. Sep 30 07:18:18 localhost kernel: PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture Sep 30 07:18:18 localhost kernel: software IO TLB: tearing down default memory pool Sep 30 07:18:18 localhost kernel: LVT offset 0 assigned for vector 0x400 Sep 30 07:18:18 localhost kernel: perf: AMD IBS detected (0x000000ff) Sep 30 07:18:18 localhost kernel: amd_uncore: 4 amd_nb counters detected Sep 30 07:18:18 localhost kernel: Initialise system trusted keyrings Sep 30 07:18:18 localhost kernel: workingset: timestamp_bits=39 max_order=23 bucket_order=0 Sep 30 07:18:18 localhost kernel: Key type asymmetric registered Sep 30 07:18:18 localhost kernel: Asymmetric key parser 'x509' registered Sep 30 07:18:18 localhost kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) Sep 30 07:18:18 localhost kernel: io scheduler mq-deadline registered Sep 30 07:18:18 localhost kernel: io scheduler kyber registered Sep 30 07:18:18 localhost kernel: io scheduler bfq registered Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P001: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P002: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P003: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P004: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P005: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P006: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P007: Found 2 idle states Sep 30 07:18:18 localhost kernel: ACPI: \_PR_.P008: Found 2 idle states Sep 30 07:18:18 localhost kernel: ioatdma: Intel(R) QuickData Technology Driver 5.00 Sep 30 07:18:18 localhost kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Sep 30 07:18:18 localhost kernel: 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Sep 30 07:18:18 localhost kernel: i8042: PNP: No PS/2 controller found. Sep 30 07:18:18 localhost kernel: i8042: Probing ports directly. Sep 30 07:18:18 localhost kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Sep 30 07:18:18 localhost kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: RTC can wake from S4 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: registered as rtc0 Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: setting system clock to 2024-09-30T07:18:17 UTC (1727680697) Sep 30 07:18:18 localhost kernel: rtc_cmos 00:01: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Sep 30 07:18:18 localhost kernel: amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled Sep 30 07:18:18 localhost kernel: NET: Registered PF_INET6 protocol family Sep 30 07:18:18 localhost kernel: Segment Routing with IPv6 Sep 30 07:18:18 localhost kernel: In-situ OAM (IOAM) with IPv6 Sep 30 07:18:18 localhost kernel: NET: Registered PF_PACKET protocol family Sep 30 07:18:18 localhost kernel: Key type dns_resolver registered Sep 30 07:18:18 localhost kernel: x86/pm: family 0x15 cpu detected, MSR saving is needed during suspending. Sep 30 07:18:18 localhost kernel: microcode: microcode updated early to new patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU6: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU7: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU1: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU3: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU2: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU4: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU5: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: CPU0: patch_level=0x06000852 Sep 30 07:18:18 localhost kernel: microcode: Microcode Update Driver: v2.2. Sep 30 07:18:18 localhost kernel: IPI shorthand broadcast: enabled Sep 30 07:18:18 localhost kernel: sched_clock: Marking stable (2619001374, 794683213)->(3696234362, -282549775) Sep 30 07:18:18 localhost kernel: registered taskstats version 1 Sep 30 07:18:18 localhost kernel: Loading compiled-in X.509 certificates Sep 30 07:18:18 localhost kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.6.48-flatcar: a53bb4e7e3319f75620f709d8a6c7aef0adb3b02' Sep 30 07:18:18 localhost kernel: Key type .fscrypt registered Sep 30 07:18:18 localhost kernel: Key type fscrypt-provisioning registered Sep 30 07:18:18 localhost kernel: ima: No TPM chip found, activating TPM-bypass! Sep 30 07:18:18 localhost kernel: ima: Allocated hash algorithm: sha1 Sep 30 07:18:18 localhost kernel: ima: No architecture policies found Sep 30 07:18:18 localhost kernel: clk: Disabling unused clocks Sep 30 07:18:18 localhost kernel: Freeing unused kernel image (initmem) memory: 49336K Sep 30 07:18:18 localhost kernel: Write protecting the kernel read-only data: 36864k Sep 30 07:18:18 localhost kernel: Freeing unused kernel image (rodata/data gap) memory: 1936K Sep 30 07:18:18 localhost kernel: Run /init as init process Sep 30 07:18:18 localhost kernel: with arguments: Sep 30 07:18:18 localhost kernel: /init Sep 30 07:18:18 localhost kernel: with environment: Sep 30 07:18:18 localhost kernel: HOME=/ Sep 30 07:18:18 localhost kernel: TERM=linux Sep 30 07:18:18 localhost kernel: BOOT_IMAGE=/flatcar/vmlinuz-b Sep 30 07:18:18 localhost kernel: biosdevname=0 Sep 30 07:18:18 localhost systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Sep 30 07:18:18 localhost systemd[1]: Detected architecture x86-64. Sep 30 07:18:18 localhost systemd[1]: Running in initrd. Sep 30 07:18:18 localhost systemd[1]: No hostname configured, using default hostname. Sep 30 07:18:18 localhost systemd[1]: Hostname set to . Sep 30 07:18:18 localhost systemd[1]: Initializing machine ID from random generator. Sep 30 07:18:18 localhost systemd[1]: Queued start job for default target initrd.target. Sep 30 07:18:18 localhost systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Sep 30 07:18:18 localhost systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartlabel-ROOT.device - /dev/disk/by-partlabel/ROOT... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c.device - /dev/disk/by-partuuid/e03dd35c-7c2d-4a47-b3fe-27f15780a57c... Sep 30 07:18:18 localhost systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Sep 30 07:18:18 localhost systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Sep 30 07:18:18 localhost kernel: tsc: Refined TSC clocksource calibration: 3214.431 MHz Sep 30 07:18:18 localhost kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2e558aca513, max_idle_ns: 440795308132 ns Sep 30 07:18:18 localhost kernel: clocksource: Switched to clocksource tsc Sep 30 07:18:18 localhost systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Sep 30 07:18:18 localhost systemd[1]: Reached target ignition-diskful-subsequent.target - Ignition Subsequent Boot Disk Setup. Sep 30 07:18:18 localhost systemd[1]: Reached target paths.target - Path Units. Sep 30 07:18:18 localhost systemd[1]: Reached target slices.target - Slice Units. Sep 30 07:18:18 localhost systemd[1]: Reached target swap.target - Swaps. Sep 30 07:18:18 localhost systemd[1]: Reached target timers.target - Timer Units. Sep 30 07:18:18 localhost systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-journald.socket - Journal Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Sep 30 07:18:18 localhost systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Sep 30 07:18:18 localhost systemd[1]: Reached target sockets.target - Socket Units. Sep 30 07:18:18 localhost systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Sep 30 07:18:18 localhost systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-fsck-usr.service... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-journald.service - Journal Service... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:18 localhost systemd-journald[213]: Collecting audit messages is disabled. Sep 30 07:18:18 localhost systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Sep 30 07:18:18 localhost systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-fsck-usr.service. Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Sep 30 07:18:18 localhost systemd-journald[213]: Journal started Sep 30 07:18:18 localhost systemd-journald[213]: Runtime Journal (/run/log/journal/a316c37be01640b1b6e800bb2c3cd8a5) is 8.0M, max 399.0M, 391.0M free. Sep 30 07:18:18 localhost systemd-modules-load[214]: Inserted module 'overlay' Sep 30 07:18:18 localhost systemd[1]: Started systemd-journald.service - Journal Service. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Sep 30 07:18:18 localhost systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Sep 30 07:18:18 localhost systemd[1]: Starting systemd-tmpfiles-setup.service - Create Volatile Files and Directories... Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Sep 30 07:18:18 localhost systemd[1]: Finished systemd-tmpfiles-setup.service - Create Volatile Files and Directories. Sep 30 07:18:18 localhost kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Sep 30 07:18:18 localhost systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:18 localhost systemd-modules-load[214]: Inserted module 'br_netfilter' Sep 30 07:18:18 localhost kernel: Bridge firewalling registered Sep 30 07:18:18 localhost systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Sep 30 07:18:18 localhost systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Sep 30 07:18:18 localhost systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Sep 30 07:18:18 localhost dracut-cmdline[242]: dracut-dracut-053 Sep 30 07:18:18 localhost systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Sep 30 07:18:18 localhost dracut-cmdline[242]: Using kernel command line parameters: rd.driver.pre=btrfs rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-b mount.usr=/dev/mapper/usr verity.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 biosdevname=0 net.ifnames=0 noefi verity.usrhash=6662bd39fec77da4c9a5c59d2cba257325976309ed96904c83697df1825085bf Sep 30 07:18:18 localhost kernel: SCSI subsystem initialized Sep 30 07:18:18 localhost kernel: Loading iSCSI transport class v2.0-870. Sep 30 07:18:18 localhost kernel: iscsi: registered transport (tcp) Sep 30 07:18:18 localhost kernel: iscsi: registered transport (qla4xxx) Sep 30 07:18:18 localhost kernel: QLogic iSCSI HBA Driver Sep 30 07:18:18 localhost kernel: random: crng init done Sep 30 07:18:18 localhost systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Sep 30 07:18:18 localhost systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Sep 30 07:18:18 localhost kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Sep 30 07:18:18 localhost kernel: device-mapper: uevent: version 1.0.3 Sep 30 07:18:18 localhost kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Sep 30 07:18:19 localhost kernel: raid6: sse2x4 gen() 8342 MB/s Sep 30 07:18:19 localhost kernel: raid6: sse2x2 gen() 7120 MB/s Sep 30 07:18:19 localhost kernel: raid6: sse2x1 gen() 5682 MB/s Sep 30 07:18:19 localhost kernel: raid6: using algorithm sse2x4 gen() 8342 MB/s Sep 30 07:18:19 localhost kernel: raid6: .... xor() 3112 MB/s, rmw enabled Sep 30 07:18:19 localhost kernel: raid6: using ssse3x2 recovery algorithm Sep 30 07:18:19 localhost kernel: xor: automatically using best checksumming function avx Sep 30 07:18:19 localhost kernel: Btrfs loaded, zoned=no, fsverity=no Sep 30 07:18:19 localhost systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Sep 30 07:18:19 localhost systemd-udevd[434]: Using default interface naming scheme 'v255'. Sep 30 07:18:19 localhost systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Sep 30 07:18:19 localhost systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Sep 30 07:18:19 localhost dracut-pre-trigger[440]: rd.md=0: removing MD RAID activation Sep 30 07:18:19 localhost systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Sep 30 07:18:19 localhost systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Sep 30 07:18:19 localhost kernel: cryptd: max_cpu_qlen set to 1000 Sep 30 07:18:19 localhost systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Sep 30 07:18:19 localhost systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:19 localhost kernel: ACPI: bus type USB registered Sep 30 07:18:19 localhost systemd[1]: Stopping dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:19 localhost systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Sep 30 07:18:19 localhost systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:19 localhost systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:19 localhost kernel: usbcore: registered new interface driver usbfs Sep 30 07:18:19 localhost kernel: usbcore: registered new interface driver hub Sep 30 07:18:19 localhost kernel: usbcore: registered new device driver usb Sep 30 07:18:19 localhost kernel: libata version 3.00 loaded. Sep 30 07:18:19 localhost systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:19 localhost kernel: AVX version of gcm_enc/dec engaged. Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: EHCI Host Controller Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: new USB bus registered, assigned bus number 1 Sep 30 07:18:19 localhost kernel: AES CTR mode by8 optimization enabled Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: applying AMD SB700/SB800/Hudson-2/3 EHCI dummy qh workaround Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: debug port 1 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: irq 17, io mem 0xfe8ff800 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:12.2: USB 2.0 started, EHCI 1.00 Sep 30 07:18:19 localhost kernel: hub 1-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: hub 1-0:1.0: 6 ports detected Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: EHCI Host Controller Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: new USB bus registered, assigned bus number 2 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: applying AMD SB700/SB800/Hudson-2/3 EHCI dummy qh workaround Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: debug port 1 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: irq 19, io mem 0xfe8ff400 Sep 30 07:18:19 localhost kernel: ehci-pci 0000:00:13.2: USB 2.0 started, EHCI 1.00 Sep 30 07:18:19 localhost systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:19 localhost kernel: hub 2-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: hub 2-0:1.0: 6 ports detected Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: OHCI PCI host controller Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: new USB bus registered, assigned bus number 3 Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.0: irq 16, io mem 0xfe8fe000 Sep 30 07:18:19 localhost systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Sep 30 07:18:19 localhost kernel: xhci_hcd 0000:02:00.0: xHCI Host Controller Sep 30 07:18:19 localhost kernel: xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 4 Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: version 3.0 Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: AHCI 0001.0100 32 slots 6 ports 3 Gbps 0x3f impl SATA mode Sep 30 07:18:19 localhost kernel: ahci 0000:00:11.0: flags: 64bit ncq sntf ilck pm led clo pmp pio slum part ccc Sep 30 07:18:19 localhost kernel: scsi host0: ahci Sep 30 07:18:19 localhost kernel: r8169 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control Sep 30 07:18:19 localhost kernel: scsi host1: ahci Sep 30 07:18:19 localhost kernel: hub 3-0:1.0: USB hub found Sep 30 07:18:19 localhost kernel: scsi host2: ahci Sep 30 07:18:19 localhost kernel: hub 3-0:1.0: 3 ports detected Sep 30 07:18:19 localhost kernel: scsi host3: ahci Sep 30 07:18:19 localhost kernel: scsi host4: ahci Sep 30 07:18:19 localhost systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.1: OHCI PCI host controller Sep 30 07:18:19 localhost kernel: ohci-pci 0000:00:12.1: new USB bus registered, assigned bus number 5 Sep 30 07:18:19 localhost kernel: scsi host5: ahci Sep 30 07:18:19 localhost kernel: ata1: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffd00 irq 22 Sep 30 07:18:19 localhost kernel: ata2: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffd80 irq 22 Sep 30 07:18:19 localhost kernel: ata3: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffe00 irq 22 Sep 30 07:18:19 localhost kernel: ata4: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8ffe80 irq 22 Sep 30 07:18:19 localhost kernel: ata5: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8fff00 irq 22 Sep 30 07:18:19 localhost kernel: ata6: SATA max UDMA/133 abar m1024@0xfe8ffc00 port 0xfe8fff80 irq 22 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: hcc params 0x0200e080 hci version 0x100 quirks 0x0000000010800410 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:12.1: irq 16, io mem 0xfe8fd000 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: xHCI Host Controller Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 6 Sep 30 07:18:20 localhost kernel: xhci_hcd 0000:02:00.0: Host supports USB 3.0 SuperSpeed Sep 30 07:18:20 localhost kernel: hub 4-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 4-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: r8169 0000:03:00.0 eth0: RTL8168f/8111f, f0:79:59:5f:d1:4c, XID 480, IRQ 26 Sep 30 07:18:20 localhost kernel: r8169 0000:03:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko] Sep 30 07:18:20 localhost kernel: usb usb6: We don't know the algorithms for LPM for this host, disabling LPM. Sep 30 07:18:20 localhost kernel: hub 6-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 6-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: hub 5-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 5-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: new USB bus registered, assigned bus number 7 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.0: irq 18, io mem 0xfe8fc000 Sep 30 07:18:20 localhost kernel: hub 7-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 7-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: new USB bus registered, assigned bus number 8 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:13.1: irq 18, io mem 0xfe8fb000 Sep 30 07:18:20 localhost kernel: hub 8-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 8-0:1.0: 3 ports detected Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: OHCI PCI host controller Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: new USB bus registered, assigned bus number 9 Sep 30 07:18:20 localhost kernel: ohci-pci 0000:00:14.5: irq 18, io mem 0xfe8fa000 Sep 30 07:18:20 localhost kernel: ata5: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata6: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata2: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: ata4: SATA link down (SStatus 0 SControl 300) Sep 30 07:18:20 localhost kernel: hub 9-0:1.0: USB hub found Sep 30 07:18:20 localhost kernel: hub 9-0:1.0: 2 ports detected Sep 30 07:18:20 localhost kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Sep 30 07:18:20 localhost kernel: ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Sep 30 07:18:20 localhost kernel: ata1.00: ATA-9: WDC WD5003AZEX-00MK2A0, 01.01A01, max UDMA/133 Sep 30 07:18:20 localhost kernel: ata3.00: ATA-11: SPCC Solid State Disk, SBFM61.3, max UDMA/133 Sep 30 07:18:20 localhost kernel: ata1.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 32), AA Sep 30 07:18:20 localhost kernel: ata3.00: 1000215216 sectors, multi 16: LBA48 NCQ (depth 32), AA Sep 30 07:18:20 localhost kernel: ata1.00: configured for UDMA/133 Sep 30 07:18:20 localhost kernel: scsi 0:0:0:0: Direct-Access ATA WDC WD5003AZEX-0 1A01 PQ: 0 ANSI: 5 Sep 30 07:18:20 localhost kernel: ata3.00: configured for UDMA/133 Sep 30 07:18:20 localhost kernel: scsi 2:0:0:0: Direct-Access ATA SPCC Solid State 61.3 PQ: 0 ANSI: 5 Sep 30 07:18:20 localhost (udev-worker)[497]: Network interface NamePolicy= disabled on kernel command line. Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] 1000215216 512-byte logical blocks: (512 GB/477 GiB) Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB) Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] 4096-byte physical blocks Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Write Protect is off Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Write Protect is off Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Mode Sense: 00 3a 00 00 Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Preferred minimum I/O size 512 bytes Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes Sep 30 07:18:20 localhost kernel: sd 2:0:0:0: [sdb] Attached SCSI disk Sep 30 07:18:20 localhost kernel: sda: sda1 sda2 sda3 sda4 sda6 sda7 sda9 Sep 30 07:18:20 localhost kernel: sd 0:0:0:0: [sda] Attached SCSI disk Sep 30 07:18:20 localhost kernel: BTRFS: device label OEM devid 1 transid 36 /dev/sda6 scanned by (udev-worker) (492) Sep 30 07:18:20 localhost kernel: BTRFS: device fsid d3844c60-0a2c-449a-9ee9-2a875f8d8e12 devid 1 transid 36 /dev/sda3 scanned by (udev-worker) (508) Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - WDC_WD5003AZEX-00MK2A0 OEM. Sep 30 07:18:21 localhost kernel: BTRFS: device fsid d110be6f-93a3-451a-b365-11b5d04e0602 devid 1 transid 33 /dev/sda4 scanned by (udev-worker) (509) Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - WDC_WD5003AZEX-00MK2A0 USR-A. Sep 30 07:18:21 localhost systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c.device - WDC_WD5003AZEX-00MK2A0 USR-B. Sep 30 07:18:21 localhost systemd[1]: disk-uuid.service: Deactivated successfully. Sep 30 07:18:21 localhost systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Sep 30 07:18:21 localhost systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target local-fs.target - Local File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target sysinit.target - System Initialization. Sep 30 07:18:21 localhost systemd[1]: Reached target basic.target - Basic System. Sep 30 07:18:21 localhost systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - WDC_WD5003AZEX-00MK2A0 ROOT. Sep 30 07:18:21 localhost systemd[1]: Found device dev-disk-by\x2dpartlabel-ROOT.device - WDC_WD5003AZEX-00MK2A0 ROOT. Sep 30 07:18:21 localhost systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Sep 30 07:18:21 localhost sh[605]: Success Sep 30 07:18:21 localhost systemd[1]: Starting decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition... Sep 30 07:18:21 localhost systemd[1]: Finished decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition. Sep 30 07:18:21 localhost systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Sep 30 07:18:21 localhost kernel: device-mapper: verity: sha256 using implementation "sha256-avx" Sep 30 07:18:21 localhost systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Sep 30 07:18:21 localhost systemd[1]: Reached target remote-fs.target - Remote File Systems. Sep 30 07:18:21 localhost systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Sep 30 07:18:21 localhost systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Sep 30 07:18:21 localhost systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Sep 30 07:18:21 localhost systemd-fsck[637]: ROOT: clean, 62030/120732480 files, 9218165/121489409 blocks Sep 30 07:18:21 localhost systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot.mount - /sysroot... Sep 30 07:18:21 localhost systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Sep 30 07:18:21 localhost systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Sep 30 07:18:21 localhost systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): first mount of filesystem d110be6f-93a3-451a-b365-11b5d04e0602 Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): using crc32c (crc32c-intel) checksum algorithm Sep 30 07:18:21 localhost kernel: BTRFS warning (device dm-0): 'nologreplay' is deprecated, use 'rescue=nologreplay' instead Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): disabling log replay at mount time Sep 30 07:18:21 localhost kernel: BTRFS info (device dm-0): using free space tree Sep 30 07:18:21 localhost kernel: EXT4-fs (sda9): mounted filesystem e865ac73-053b-4efa-9a0f-50dec3f650d9 r/w with ordered data mode. Quota mode: none. Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot.mount - /sysroot. Sep 30 07:18:21 localhost systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Sep 30 07:18:21 localhost systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Sep 30 07:18:21 localhost systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Sep 30 07:18:21 localhost systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): first mount of filesystem b6695624-d538-4f05-9ddd-23ee987404c1 Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): using crc32c (crc32c-intel) checksum algorithm Sep 30 07:18:21 localhost kernel: BTRFS info (device sda6): using free space tree Sep 30 07:18:21 localhost systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[985]: grep: /sysroot/oem/oem-release: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[987]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[987]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost initrd-setup-root-after-ignition[991]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Sep 30 07:18:22 localhost systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Sep 30 07:18:22 localhost systemd[1]: Reached target ignition-subsequent.target - Subsequent (Not Ignition) boot complete. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Sep 30 07:18:22 localhost systemd[1]: initrd-parse-etc.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd.target - Initrd Default Target. Sep 30 07:18:22 localhost systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Sep 30 07:18:22 localhost systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Sep 30 07:18:22 localhost systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Sep 30 07:18:22 localhost systemd[1]: Stopped target timers.target - Timer Units. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Sep 30 07:18:22 localhost systemd[1]: Stopped target initrd.target - Initrd Default Target. Sep 30 07:18:22 localhost systemd[1]: Stopped target basic.target - Basic System. Sep 30 07:18:22 localhost systemd[1]: Stopped target ignition-subsequent.target - Subsequent (Not Ignition) boot complete. Sep 30 07:18:22 localhost systemd[1]: Stopped target ignition-diskful-subsequent.target - Ignition Subsequent Boot Disk Setup. Sep 30 07:18:22 localhost systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Sep 30 07:18:22 localhost systemd[1]: Stopped target paths.target - Path Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-fs.target - Remote File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target slices.target - Slice Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target sockets.target - Socket Units. Sep 30 07:18:22 localhost systemd[1]: Stopped target sysinit.target - System Initialization. Sep 30 07:18:22 localhost systemd[1]: Stopped target local-fs.target - Local File Systems. Sep 30 07:18:22 localhost systemd[1]: Stopped target swap.target - Swaps. Sep 30 07:18:22 localhost systemd[1]: iscsid.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Sep 30 07:18:22 localhost systemd[1]: iscsiuio.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-mount.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Sep 30 07:18:22 localhost systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Sep 30 07:18:22 localhost systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Sep 30 07:18:22 localhost systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Sep 30 07:18:22 localhost systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Sep 30 07:18:22 localhost systemd[1]: dracut-initqueue.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Sep 30 07:18:22 localhost systemd[1]: decrypt-root.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped decrypt-root.service - Generate and execute a systemd-cryptsetup service to decrypt the ROOT partition. Sep 30 07:18:22 localhost systemd[1]: ignition-setup-pre.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Sep 30 07:18:22 localhost systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Sep 30 07:18:22 localhost systemd[1]: initrd-setup-root.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Sep 30 07:18:22 localhost systemd[1]: kmod-static-nodes.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Sep 30 07:18:22 localhost systemd[1]: systemd-sysctl.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Sep 30 07:18:22 localhost systemd[1]: systemd-modules-load.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Sep 30 07:18:22 localhost systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-tmpfiles-setup.service - Create Volatile Files and Directories. Sep 30 07:18:22 localhost systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Sep 30 07:18:22 localhost systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Sep 30 07:18:22 localhost systemd[1]: initrd-cleanup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Sep 30 07:18:22 localhost systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Sep 30 07:18:22 localhost systemd[1]: dracut-pre-udev.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Sep 30 07:18:22 localhost systemd[1]: dracut-cmdline.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Sep 30 07:18:22 localhost systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Sep 30 07:18:22 localhost systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Sep 30 07:18:22 localhost systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:22 localhost systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Sep 30 07:18:22 localhost systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Sep 30 07:18:22 localhost systemd[1]: Reached target initrd-switch-root.target - Switch Root. Sep 30 07:18:22 localhost systemd[1]: Starting initrd-switch-root.service - Switch Root... Sep 30 07:18:22 localhost systemd[1]: Switching root. Sep 30 07:18:22 localhost systemd-journald[213]: Journal stopped Sep 30 07:18:27 kc05 systemd-journald[213]: Received SIGTERM from PID 1 (systemd). Sep 30 07:18:27 kc05 kernel: SELinux: policy capability network_peer_controls=1 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability open_perms=1 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability extended_socket_class=1 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability always_check_network=0 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability cgroup_seclabel=1 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability nnp_nosuid_transition=1 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Sep 30 07:18:27 kc05 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Sep 30 07:18:27 kc05 kernel: audit: type=1403 audit(1727680704.924:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Sep 30 07:18:27 kc05 systemd[1]: Successfully loaded SELinux policy in 549.704ms. Sep 30 07:18:27 kc05 systemd[1]: Relabeled /dev, /dev/shm, /run, /sys/fs/cgroup in 13.291ms. Sep 30 07:18:27 kc05 systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Sep 30 07:18:27 kc05 systemd[1]: Detected architecture x86-64. Sep 30 07:18:27 kc05 systemd[1]: Hostname set to . Sep 30 07:18:27 kc05 zram_generator::config[1033]: No configuration found. Sep 30 07:18:27 kc05 systemd[1]: initrd-switch-root.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Sep 30 07:18:27 kc05 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Sep 30 07:18:27 kc05 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Sep 30 07:18:27 kc05 systemd[1]: Created slice user.slice - User and Session Slice. Sep 30 07:18:27 kc05 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Sep 30 07:18:27 kc05 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Sep 30 07:18:27 kc05 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Sep 30 07:18:27 kc05 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Sep 30 07:18:27 kc05 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Sep 30 07:18:27 kc05 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Sep 30 07:18:27 kc05 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Sep 30 07:18:27 kc05 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Sep 30 07:18:27 kc05 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Sep 30 07:18:27 kc05 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Sep 30 07:18:27 kc05 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Sep 30 07:18:27 kc05 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Sep 30 07:18:27 kc05 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Sep 30 07:18:27 kc05 systemd[1]: Reached target remote-fs.target - Remote File Systems. Sep 30 07:18:27 kc05 systemd[1]: Reached target slices.target - Slice Units. Sep 30 07:18:27 kc05 systemd[1]: Reached target swap.target - Swaps. Sep 30 07:18:27 kc05 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Sep 30 07:18:27 kc05 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Sep 30 07:18:27 kc05 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Sep 30 07:18:27 kc05 systemd[1]: Mounting media.mount - External Media Directory... Sep 30 07:18:27 kc05 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:27 kc05 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Sep 30 07:18:27 kc05 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Sep 30 07:18:27 kc05 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Sep 30 07:18:27 kc05 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Sep 30 07:18:27 kc05 systemd[1]: Reached target machines.target - Containers. Sep 30 07:18:27 kc05 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Sep 30 07:18:27 kc05 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because of an unmet condition check (ConditionFirstBoot=true). Sep 30 07:18:27 kc05 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Sep 30 07:18:27 kc05 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Sep 30 07:18:27 kc05 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Sep 30 07:18:27 kc05 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Sep 30 07:18:27 kc05 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Stopped systemd-fsck-usr.service. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-journald.service - Journal Service... Sep 30 07:18:27 kc05 kernel: fuse: init (API version 7.39) Sep 30 07:18:27 kc05 kernel: loop: module loaded Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Sep 30 07:18:27 kc05 systemd-journald[1111]: Collecting audit messages is disabled. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Sep 30 07:18:27 kc05 systemd-journald[1111]: Journal started Sep 30 07:18:27 kc05 systemd-journald[1111]: Runtime Journal (/run/log/journal/bc75ee0ce47d433b85b63252a30fea38) is 8.0M, max 399.0M, 391.0M free. Sep 30 07:18:26 kc05 systemd[1]: Queued start job for default target multi-user.target. Sep 30 07:18:26 kc05 systemd[1]: Unnecessary job was removed for dev-sda6.device - /dev/sda6. Sep 30 07:18:26 kc05 systemd[1]: systemd-journald.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Sep 30 07:18:27 kc05 systemd[1]: verity-setup.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Stopped verity-setup.service. Sep 30 07:18:27 kc05 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:27 kc05 kernel: ACPI: bus type drm_connector registered Sep 30 07:18:27 kc05 systemd[1]: Started systemd-journald.service - Journal Service. Sep 30 07:18:27 kc05 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Sep 30 07:18:27 kc05 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Sep 30 07:18:27 kc05 systemd[1]: Mounted media.mount - External Media Directory. Sep 30 07:18:27 kc05 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Sep 30 07:18:27 kc05 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Sep 30 07:18:27 kc05 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Sep 30 07:18:27 kc05 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Sep 30 07:18:27 kc05 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Sep 30 07:18:27 kc05 systemd[1]: modprobe@configfs.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Sep 30 07:18:27 kc05 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Sep 30 07:18:27 kc05 systemd[1]: modprobe@drm.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Sep 30 07:18:27 kc05 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Sep 30 07:18:27 kc05 systemd[1]: modprobe@fuse.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Sep 30 07:18:27 kc05 systemd[1]: modprobe@loop.service: Deactivated successfully. Sep 30 07:18:27 kc05 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Sep 30 07:18:27 kc05 systemd[1]: Reached target network-pre.target - Preparation for Network. Sep 30 07:18:27 kc05 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Sep 30 07:18:27 kc05 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Sep 30 07:18:27 kc05 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Sep 30 07:18:27 kc05 systemd[1]: Reached target local-fs.target - Local File Systems. Sep 30 07:18:27 kc05 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management (Varlink). Sep 30 07:18:27 kc05 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Sep 30 07:18:27 kc05 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Sep 30 07:18:27 kc05 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Sep 30 07:18:27 kc05 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Sep 30 07:18:27 kc05 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-sysusers.service - Create System Users... Sep 30 07:18:27 kc05 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Sep 30 07:18:27 kc05 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Sep 30 07:18:27 kc05 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Sep 30 07:18:27 kc05 systemd-journald[1111]: Time spent on flushing to /var/log/journal/bc75ee0ce47d433b85b63252a30fea38 is 1.494332s for 974 entries. Sep 30 07:18:27 kc05 systemd-journald[1111]: System Journal (/var/log/journal/bc75ee0ce47d433b85b63252a30fea38) is 1.9G, max 4.0G, 2.0G free. Sep 30 07:18:29 kc05 systemd-journald[1111]: Received client request to flush runtime journal. Sep 30 07:18:29 kc05 kernel: loop0: detected capacity change from 0 to 80568 Sep 30 07:18:29 kc05 kernel: block loop0: the capability attribute has been deprecated. Sep 30 07:18:29 kc05 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Sep 30 07:18:29 kc05 systemd-journald[1111]: /var/log/journal/bc75ee0ce47d433b85b63252a30fea38/system.journal: Journal file uses a different sequence number ID, rotating. Sep 30 07:18:29 kc05 systemd-journald[1111]: Rotating system journal. Sep 30 07:18:29 kc05 kernel: loop1: detected capacity change from 0 to 205544 Sep 30 07:18:29 kc05 kernel: loop2: detected capacity change from 0 to 139904 Sep 30 07:18:29 kc05 kernel: loop3: detected capacity change from 0 to 80568 Sep 30 07:18:29 kc05 kernel: loop4: detected capacity change from 0 to 205544 Sep 30 07:18:29 kc05 kernel: loop5: detected capacity change from 0 to 139904 Sep 30 07:18:29 kc05 kernel: ACPI Warning: SystemIO range 0x0000000000000B00-0x0000000000000B08 conflicts with OpRegion 0x0000000000000B00-0x0000000000000B0F (\SOR1) (20230628/utaddress-204) Sep 30 07:18:29 kc05 kernel: ACPI Warning: SystemIO range 0x0000000000000B00-0x0000000000000B08 conflicts with OpRegion 0x0000000000000B00-0x0000000000000B2F (\_SB.PCI0.SBRG.ASOC.SMRG) (20230628/utaddress-204) Sep 30 07:18:29 kc05 kernel: ACPI Warning: SystemIO range 0x0000000000000B00-0x0000000000000B08 conflicts with OpRegion 0x0000000000000B00-0x0000000000000B2F (\SMRG) (20230628/utaddress-204) Sep 30 07:18:29 kc05 kernel: ACPI: OSL: Resource conflict; ACPI support missing from driver? Sep 30 07:18:29 kc05 kernel: acpi_cpufreq: overriding BIOS provided _PSD data Sep 30 07:18:29 kc05 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input4 Sep 30 07:18:29 kc05 kernel: ACPI: button: Power Button [PWRB] Sep 30 07:18:29 kc05 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input5 Sep 30 07:18:29 kc05 kernel: ACPI: button: Power Button [PWRF] Sep 30 07:18:29 kc05 ldconfig[1150]: /sbin/ldconfig: /lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-udev-settle.service - Wait for udev To Complete Device Initialization... Sep 30 07:18:27 kc05 udevadm[1163]: systemd-udev-settle.service is deprecated. Please fix lvm2-activation-early.service, lvm2-activation.service not to pull it in. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Sep 30 07:18:27 kc05 systemd[1]: first-boot-complete.target - First Boot Complete was skipped because of an unmet condition check (ConditionFirstBoot=yes). Sep 30 07:18:27 kc05 systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id). Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-sysusers.service - Create System Users. Sep 30 07:18:27 kc05 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Sep 30 07:18:27 kc05 systemd-tmpfiles[1170]: ACLs are not supported, ignoring. Sep 30 07:18:27 kc05 systemd-tmpfiles[1170]: ACLs are not supported, ignoring. Sep 30 07:18:27 kc05 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Sep 30 07:18:28 kc05 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Sep 30 07:18:28 kc05 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Sep 30 07:18:28 kc05 systemd-udevd[1180]: Using default interface naming scheme 'v255'. Sep 30 07:18:29 kc05 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Sep 30 07:18:29 kc05 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Sep 30 07:18:29 kc05 systemd[1]: Starting systemd-networkd.service - Network Configuration... Sep 30 07:18:29 kc05 (udev-worker)[1193]: Network interface NamePolicy= disabled on kernel command line. Sep 30 07:18:29 kc05 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Sep 30 07:18:29 kc05 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Sep 30 07:18:29 kc05 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Sep 30 07:18:29 kc05 systemd[1]: Started systemd-userdbd.service - User Database Manager. Sep 30 07:18:29 kc05 (sd-merge)[1178]: Using extensions 'containerd-flatcar', 'docker-flatcar', 'kubernetes'. Sep 30 07:18:29 kc05 (sd-merge)[1178]: Merged extensions into '/usr'. Sep 30 07:18:29 kc05 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Sep 30 07:18:29 kc05 systemd[1]: Reloading requested from client PID 1155 ('systemd-sysext') (unit systemd-sysext.service)... Sep 30 07:18:29 kc05 systemd[1]: Reloading... Sep 30 07:18:29 kc05 kernel: BTRFS warning: duplicate device /dev/sda4 devid 1 generation 33 scanned by (udev-worker) (1201) Sep 30 07:18:29 kc05 zram_generator::config[1262]: No configuration found. Sep 30 07:18:29 kc05 kernel: kvm_amd: SVM disabled (by BIOS) in MSR_VM_CR on CPU 6 Sep 30 07:18:30 kc05 kernel: EDAC MC: Ver: 3.0.0 Sep 30 07:18:30 kc05 kernel: BTRFS info: devid 1 device path /dev/mapper/usr changed to /dev/dm-0 scanned by (udev-worker) (1187) Sep 30 07:18:30 kc05 kernel: MCE: In-kernel MCE decoding enabled. Sep 30 07:18:30 kc05 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Sep 30 07:18:30 kc05 systemd[1]: Reloading finished in 400 ms. Sep 30 07:18:30 kc05 systemd-networkd[1186]: lo: Link UP Sep 30 07:18:30 kc05 systemd-networkd[1186]: lo: Gained carrier Sep 30 07:18:30 kc05 systemd-networkd[1186]: Enumeration completed Sep 30 07:18:30 kc05 systemd-networkd[1186]: eth0: Configuring with /etc/systemd/network/kc05.network. Sep 30 07:18:30 kc05 systemd[1]: Started systemd-networkd.service - Network Configuration. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Sep 30 07:18:30 kc05 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - WDC_WD5003AZEX-00MK2A0 OEM. Sep 30 07:18:30 kc05 systemd[1]: Starting ensure-sysext.service... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-tmpfiles-setup.service - Create Volatile Files and Directories... Sep 30 07:18:30 kc05 systemd[1]: Reloading requested from client PID 1312 ('systemctl') (unit ensure-sysext.service)... Sep 30 07:18:30 kc05 systemd[1]: Reloading... Sep 30 07:18:30 kc05 kernel: RTL8211E Gigabit Ethernet r8169-0-300:00: attached PHY driver (mii_bus:phy_addr=r8169-0-300:00, irq=MAC) Sep 30 07:18:30 kc05 zram_generator::config[1344]: No configuration found. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: ACLs are not supported, ignoring. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: ACLs are not supported, ignoring. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: Detected autofs mount point /boot during canonicalization of boot. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: Skipping /boot Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: Detected autofs mount point /boot during canonicalization of boot. Sep 30 07:18:30 kc05 systemd-tmpfiles[1316]: Skipping /boot Sep 30 07:18:30 kc05 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Sep 30 07:18:30 kc05 systemd-networkd[1186]: eth0: Link UP Sep 30 07:18:30 kc05 kernel: r8169 0000:03:00.0 eth0: Link is Down Sep 30 07:18:30 kc05 systemd[1]: Reloading finished in 317 ms. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-udev-settle.service - Wait for udev To Complete Device Initialization. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-tmpfiles-setup.service - Create Volatile Files and Directories. Sep 30 07:18:30 kc05 systemd[1]: Starting audit-rules.service - Load Security Auditing Rules... Sep 30 07:18:30 kc05 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Sep 30 07:18:30 kc05 systemd[1]: Starting lvm2-activation-early.service - Activation of LVM2 logical volumes... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Sep 30 07:18:30 kc05 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because of an unmet condition check (ConditionFirstBoot=true). Sep 30 07:18:30 kc05 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Sep 30 07:18:30 kc05 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Sep 30 07:18:30 kc05 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Sep 30 07:18:30 kc05 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Sep 30 07:18:30 kc05 systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id). Sep 30 07:18:30 kc05 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because of an unmet condition check (ConditionFirstBoot=true). Sep 30 07:18:30 kc05 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Sep 30 07:18:30 kc05 systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id). Sep 30 07:18:30 kc05 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Sep 30 07:18:30 kc05 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Sep 30 07:18:30 kc05 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Sep 30 07:18:30 kc05 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Sep 30 07:18:30 kc05 systemd[1]: modprobe@loop.service: Deactivated successfully. Sep 30 07:18:30 kc05 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Sep 30 07:18:30 kc05 systemd[1]: Finished ensure-sysext.service. Sep 30 07:18:30 kc05 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because of an unmet condition check (ConditionFirstBoot=true). Sep 30 07:18:30 kc05 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Sep 30 07:18:30 kc05 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Sep 30 07:18:30 kc05 systemd[1]: systemd-machine-id-commit.service - Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id). Sep 30 07:18:30 kc05 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Sep 30 07:18:30 kc05 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-timesyncd.service - Network Time Synchronization... Sep 30 07:18:30 kc05 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Sep 30 07:18:30 kc05 systemd[1]: modprobe@drm.service: Deactivated successfully. Sep 30 07:18:30 kc05 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Sep 30 07:18:30 kc05 lvm[1402]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Sep 30 07:18:30 kc05 augenrules[1400]: /sbin/augenrules: No change Sep 30 07:18:30 kc05 systemd[1]: Started systemd-timesyncd.service - Network Time Synchronization. Sep 30 07:18:30 kc05 systemd[1]: Reached target time-set.target - System Time Set. Sep 30 07:18:30 kc05 augenrules[1429]: No rules Sep 30 07:18:30 kc05 systemd[1]: Finished audit-rules.service - Load Security Auditing Rules. Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Sep 30 07:18:30 kc05 systemd[1]: Starting systemd-update-done.service - Update is Completed... Sep 30 07:18:30 kc05 systemd-resolved[1404]: Positive Trust Anchors: Sep 30 07:18:30 kc05 systemd-resolved[1404]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Sep 30 07:18:30 kc05 systemd-resolved[1404]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa corp home internal intranet lan local private test Sep 30 07:18:30 kc05 systemd[1]: Finished systemd-update-done.service - Update is Completed. Sep 30 07:18:30 kc05 systemd[1]: Finished lvm2-activation-early.service - Activation of LVM2 logical volumes. Sep 30 07:18:30 kc05 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Sep 30 07:18:31 kc05 systemd[1]: Starting lvm2-activation.service - Activation of LVM2 logical volumes... Sep 30 07:18:31 kc05 lvm[1440]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Sep 30 07:18:31 kc05 systemd-resolved[1404]: Using system hostname 'kc05'. Sep 30 07:18:31 kc05 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Sep 30 07:18:31 kc05 systemd[1]: Reached target network.target - Network. Sep 30 07:18:31 kc05 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Sep 30 07:18:31 kc05 systemd[1]: Finished lvm2-activation.service - Activation of LVM2 logical volumes. Sep 30 07:18:31 kc05 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Sep 30 07:18:31 kc05 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Sep 30 07:18:31 kc05 systemd[1]: Reached target sysinit.target - System Initialization. Sep 30 07:18:31 kc05 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Sep 30 07:18:31 kc05 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Sep 30 07:18:31 kc05 systemd[1]: Started logrotate.timer - Daily rotation of log files. Sep 30 07:18:31 kc05 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Sep 30 07:18:31 kc05 systemd[1]: Started systemd-sysupdate.timer - Automatic System Update. Sep 30 07:18:31 kc05 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Sep 30 07:18:31 kc05 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Sep 30 07:18:31 kc05 systemd[1]: Reached target paths.target - Path Units. Sep 30 07:18:31 kc05 systemd[1]: Reached target timers.target - Timer Units. Sep 30 07:18:31 kc05 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Sep 30 07:18:31 kc05 systemd[1]: Starting docker.socket - Docker Socket for the API... Sep 30 07:18:31 kc05 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Sep 30 07:18:31 kc05 systemd[1]: Listening on docker.socket - Docker Socket for the API. Sep 30 07:18:31 kc05 systemd[1]: Reached target sockets.target - Socket Units. Sep 30 07:18:31 kc05 systemd[1]: Reached target basic.target - Basic System. Sep 30 07:18:31 kc05 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Sep 30 07:18:31 kc05 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Sep 30 07:18:31 kc05 systemd[1]: Starting containerd.service - containerd container runtime... Sep 30 07:18:31 kc05 systemd[1]: coreos-metadata.service - Flatcar Metadata Agent was skipped because no trigger condition checks were met. Sep 30 07:18:31 kc05 systemd[1]: Starting cpu-governor.service - CPU Governor: OnDemand... Sep 30 07:18:31 kc05 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Sep 30 07:18:31 kc05 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Sep 30 07:18:31 kc05 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Sep 30 07:18:31 kc05 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Sep 30 07:18:31 kc05 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Sep 30 07:18:31 kc05 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because of an unmet condition check (ConditionFirstBoot=true). Sep 30 07:18:31 kc05 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Sep 30 07:18:31 kc05 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Sep 30 07:18:31 kc05 systemd[1]: Starting systemd-logind.service - User Login Management... Sep 30 07:18:31 kc05 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Sep 30 07:18:31 kc05 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Sep 30 07:18:31 kc05 systemd[1]: Starting update-engine.service - Update Engine... Sep 30 07:18:31 kc05 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Sep 30 07:18:31 kc05 systemd[1]: motdgen.service: Deactivated successfully. Sep 30 07:18:31 kc05 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Sep 30 07:18:31 kc05 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Sep 30 07:18:31 kc05 systemd-logind[1453]: Watching system buttons on /dev/input/event1 (Power Button) Sep 30 07:18:31 kc05 systemd-logind[1453]: Watching system buttons on /dev/input/event0 (Power Button) Sep 30 07:18:31 kc05 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Sep 30 07:18:31 kc05 systemd-logind[1453]: New seat seat0. Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found loop3 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found loop4 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found loop5 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda1 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda2 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda3 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda4 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found usr Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda6 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda7 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sda9 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Checking size of /dev/sda9 Sep 30 07:18:31 kc05 systemd[1]: Started systemd-logind.service - User Login Management. Sep 30 07:18:31 kc05 jq[1448]: false Sep 30 07:18:31 kc05 jq[1469]: true Sep 30 07:18:31 kc05 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Sep 30 07:18:31 kc05 systemd[1]: Starting issuegen.service - Generate /run/issue... Sep 30 07:18:31 kc05 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Sep 30 07:18:31 kc05 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Sep 30 07:18:31 kc05 sh[1481]: ondemand Sep 30 07:18:31 kc05 systemd[1]: issuegen.service: Deactivated successfully. Sep 30 07:18:31 kc05 systemd[1]: Finished issuegen.service - Generate /run/issue. Sep 30 07:18:31 kc05 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Sep 30 07:18:31 kc05 jq[1486]: false Sep 30 07:18:31 kc05 systemd[1]: update-ssh-keys-after-ignition.service: Skipped due to 'exec-condition'. Sep 30 07:18:31 kc05 systemd[1]: Condition check resulted in update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition being skipped. Sep 30 07:18:31 kc05 systemd[1]: sshkeys.service was skipped because no trigger condition checks were met. Sep 30 07:18:31 kc05 dbus-daemon[1447]: [system] SELinux support is enabled Sep 30 07:18:31 kc05 systemd[1]: Started dbus.service - D-Bus System Message Bus. Sep 30 07:18:31 kc05 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Sep 30 07:18:31 kc05 dbus-daemon[1447]: [system] Successfully activated service 'org.freedesktop.systemd1' Sep 30 07:18:31 kc05 systemd[1]: Started getty@tty1.service - Getty on tty1. Sep 30 07:18:31 kc05 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Sep 30 07:18:31 kc05 systemd[1]: Reached target getty.target - Login Prompts. Sep 30 07:18:31 kc05 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Sep 30 07:18:31 kc05 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Sep 30 07:18:31 kc05 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Sep 30 07:18:31 kc05 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Sep 30 07:18:31 kc05 systemd[1]: Finished cpu-governor.service - CPU Governor: OnDemand. Sep 30 07:18:31 kc05 extend-filesystems[1449]: Old size kept for /dev/sda9 Sep 30 07:18:31 kc05 extend-filesystems[1449]: Found sdb Sep 30 07:18:31 kc05 systemd[1]: extend-filesystems.service: Deactivated successfully. Sep 30 07:18:31 kc05 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Sep 30 07:18:31 kc05 kernel: BTRFS warning: duplicate device /dev/sda4 devid 1 generation 33 scanned by (udev-worker) (1184) Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.102190 1468 main.cc:92] Flatcar Update Engine starting Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.117159 1468 payload_state.cc:360] Current Response Signature = Sep 30 07:18:32 kc05 update_engine[1468]: NumURLs = 1 Sep 30 07:18:32 kc05 update_engine[1468]: Url0 = https://update.release.flatcar-linux.net/amd64-usr/3975.2.1/flatcar_production_update.gz Sep 30 07:18:32 kc05 update_engine[1468]: Payload Size = 473482779 Sep 30 07:18:32 kc05 update_engine[1468]: Payload Sha256 Hash = NaXSbuUgPPy2+Yg2FvO3Hr2Ljx5qMw6m/z0JlmOjh2U= Sep 30 07:18:32 kc05 update_engine[1468]: Is Delta Payload = 0 Sep 30 07:18:32 kc05 update_engine[1468]: Max Failure Count Per Url = 10 Sep 30 07:18:32 kc05 update_engine[1468]: Disable Payload Backoff = 1 Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.117563 1468 payload_state.cc:381] Payload Attempt Number = 1 Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.117838 1468 payload_state.cc:404] Current URL Index = 0 Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.118126 1468 payload_state.cc:425] Current URL (Url0)'s Failure Count = 0 Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.118404 1468 payload_state.cc:452] Backoff Expiry Time = 01/01/70 00:00:00 UTC Sep 30 07:18:32 kc05 update_engine[1468]: I0930 07:18:32.120147 1468 update_check_scheduler.cc:74] Next update check in 11m7s Sep 30 07:18:32 kc05 systemd[1]: Started update-engine.service - Update Engine. Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.137378127Z" level=info msg="starting containerd" revision=1fbfc07f8d28210e62bdbcbf7b950bac8028afbf version=v1.7.17 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.171076832Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.171121651Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.173633551Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/6.6.48-flatcar\\n\"): skip plugin" type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.173690488Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.173922081Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.173955766Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174226357Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174402635Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174429859Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174607752Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174917597Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174952270Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.174973896Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.175153365Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.175181152Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.175224465Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.175244958Z" level=info msg="metadata content store policy set" policy=shared Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318434202Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318519940Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318554387Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318619531Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318656481Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318684383Z" level=info msg="NRI interface is disabled by configuration." Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318714341Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318889653Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318929517Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.318963457Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319018732Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319063112Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319105692Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319142102Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319174884Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319208925Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319245143Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319278827Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319309145Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.319495379Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320016410Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320073633Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320108225Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320157377Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320276394Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320311761Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320346739Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320378131Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320410721Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320469372Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320502336Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320533850Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320581506Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320812310Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320837799Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320859532Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320882039Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320903040Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320934303Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320955264Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.320974602Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321297725Z" level=warning msg="`mirrors` is deprecated, please use `config_path` instead" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321311820Z" level=warning msg="`configs.tls` is deprecated, please use `config_path` instead" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321323518Z" level=warning msg="`configs` is deprecated, please use `config_path` instead" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321404161Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:runc DefaultRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} UntrustedWorkloadRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} Runtimes:map[runc:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[SystemdCgroup:true] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false IgnoreBlockIONotEnabledErrors:false IgnoreRdtNotEnabledErrors:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPluginConfDir:/etc/cni/net.d NetworkPluginMaxConfNum:1 NetworkPluginSetupSerially:false NetworkPluginConfTemplate: IPPreference:} Registry:{ConfigPath: Mirrors:map[docker:80:{Endpoints:[http://docker:80]}] Configs:map[docker:80:{Auth: TLS:0xc00040ba40}] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:node} DisableTCPService:true StreamServerAddress:127.0.0.1 StreamServerPort:0 StreamIdleTimeout:4h0m0s EnableSelinux:true SelinuxCategoryRange:1024 SandboxImage:registry.k8s.io/pause:3.8 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true DeviceOwnershipFromSecurityContext:false IgnoreImageDefinedVolumes:false NetNSMountsUnderStateDir:false EnableUnprivilegedPorts:false EnableUnprivilegedICMP:false EnableCDI:false CDISpecDirs:[/etc/cdi /var/run/cdi] ImagePullProgressTimeout:5m0s DrainExecSyncIOTimeout:0s ImagePullWithSyncFs:false IgnoreDeprecationWarnings:[]} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321511380Z" level=info msg="Connect containerd service" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321557624Z" level=info msg="using legacy CRI server" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321569520Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.321683396Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\"" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327176679Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327244059Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327284126Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327326288Z" level=info msg="Start subscribing containerd event" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327481386Z" level=info msg="Start recovering state" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.327332080Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1 Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.328110778Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.328233493Z" level=info msg=serving... address=/run/containerd/containerd.sock Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.869629991Z" level=info msg="Start event monitor" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.869676733Z" level=info msg="Start snapshots syncer" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.869691973Z" level=info msg="Start cni network conf syncer for default" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.869702600Z" level=info msg="Start streaming server" Sep 30 07:18:32 kc05 containerd[1478]: time="2024-09-30T07:18:32.869793939Z" level=info msg="containerd successfully booted in 0.743196s" Sep 30 07:18:32 kc05 systemd[1]: Started containerd.service - containerd container runtime. Sep 30 07:18:33 kc05 systemd-networkd[1186]: eth0: Gained carrier Sep 30 07:18:33 kc05 kernel: r8169 0000:03:00.0 eth0: Link is Up - 1Gbps/Full - flow control off Sep 30 07:18:33 kc05 systemd-timesyncd[1415]: Network configuration changed, trying to establish connection. Sep 30 07:18:33 kc05 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Sep 30 07:18:33 kc05 systemd[1]: Reached target network-online.target - Network is Online. Sep 30 07:18:33 kc05 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Sep 30 07:18:33 kc05 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Sep 30 07:18:33 kc05 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Sep 30 07:18:34 kc05 systemd-timesyncd[1415]: Contacted time server 85.215.93.134:123 (0.flatcar.pool.ntp.org). Sep 30 07:18:34 kc05 systemd-timesyncd[1415]: Initial clock synchronization to Mon 2024-09-30 07:18:34.743143 UTC. Sep 30 07:18:35 kc05 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Sep 30 07:18:35 kc05 systemd[1]: Reached target multi-user.target - Multi-User System. Sep 30 07:18:35 kc05 systemd[1]: Startup finished in 2.864s (kernel) + 6.509s (initrd) + 10.753s (userspace) = 20.127s. Sep 30 07:18:35 kc05 (kubelet)[1593]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Sep 30 07:18:36 kc05 kubelet[1593]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 30 07:18:36 kc05 kubelet[1593]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.134315 1593 server.go:206] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.176558 1593 server.go:486] "Kubelet version" kubeletVersion="v1.31.0" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.176591 1593 server.go:488] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.176846 1593 server.go:929] "Client rotation is on, will bootstrap in background" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.188957 1593 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.213080 1593 dynamic_cafile_content.go:160] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Sep 30 07:18:36 kc05 kubelet[1593]: E0930 07:18:36.229561 1593 log.go:32] "RuntimeConfig from runtime service failed" err="rpc error: code = Unimplemented desc = unknown method RuntimeConfig for service runtime.v1.RuntimeService" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.229619 1593 server.go:1403] "CRI implementation should be updated to support RuntimeConfig when KubeletCgroupDriverFromCRI feature gate has been enabled. Falling back to using cgroupDriver from kubelet config." Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.241533 1593 server.go:744] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.241667 1593 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.241823 1593 container_manager_linux.go:264] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.241853 1593 container_manager_linux.go:269] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"kc05","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.242118 1593 topology_manager.go:138] "Creating topology manager with none policy" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.242133 1593 container_manager_linux.go:300] "Creating device plugin manager" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.242195 1593 state_mem.go:36] "Initialized new in-memory state store" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.243761 1593 kubelet.go:408] "Attempting to sync node with API server" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.243782 1593 kubelet.go:303] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.243826 1593 kubelet.go:314] "Adding apiserver pod source" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.243846 1593 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.250904 1593 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="containerd" version="v1.7.17" apiVersion="v1" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.253259 1593 kubelet.go:837] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.280920 1593 server.go:1269] "Started kubelet" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.281117 1593 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.281414 1593 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.282239 1593 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.296685 1593 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.296701 1593 scope.go:117] "RemoveContainer" containerID="690c454b840a65ee01548092470efe5426b490c5788de4f25ce102f3012f335e" Sep 30 07:18:36 kc05 kubelet[1593]: W0930 07:18:36.297044 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:18:36 kc05 kubelet[1593]: E0930 07:18:36.297119 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.297433 1593 server.go:460] "Adding debug handlers to kubelet server" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.297525 1593 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.298879 1593 volume_manager.go:289] "Starting Kubelet Volume Manager" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.299741 1593 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 30 07:18:36 kc05 kubelet[1593]: E0930 07:18:36.300604 1593 kubelet_node_status.go:453] "Error getting the current node from lister" err="node \"kc05\" not found" Sep 30 07:18:36 kc05 kubelet[1593]: E0930 07:18:36.303316 1593 kubelet.go:1478] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.327782 1593 factory.go:221] Registration of the systemd container factory successfully Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.328078 1593 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.374377 1593 factory.go:221] Registration of the containerd container factory successfully Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.378052546Z" level=info msg="RemoveContainer for \"690c454b840a65ee01548092470efe5426b490c5788de4f25ce102f3012f335e\"" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.386311 1593 cpu_manager.go:214] "Starting CPU manager" policy="none" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.386335 1593 cpu_manager.go:215] "Reconciling" reconcilePeriod="10s" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.386369 1593 state_mem.go:36] "Initialized new in-memory state store" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.397818 1593 state_mem.go:88] "Updated default CPUSet" cpuSet="" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.397857 1593 state_mem.go:96] "Updated CPUSet assignments" assignments={} Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.397917 1593 policy_none.go:49] "None policy: Start" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.399415 1593 memory_manager.go:170] "Starting memorymanager" policy="None" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.399448 1593 state_mem.go:35] "Initializing new in-memory state store" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.430853 1593 state_mem.go:75] "Updated machine memory state" Sep 30 07:18:36 kc05 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Sep 30 07:18:36 kc05 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Sep 30 07:18:36 kc05 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.509116 1593 manager.go:510] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.509682 1593 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.509712 1593 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.511467 1593 kuberuntime_manager.go:1633] "Updating runtime config through cri with podcidr" CIDR="10.42.2.0/24" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.511943711Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.512275 1593 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.2.0/24" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.512379 1593 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.513649090Z" level=info msg="RemoveContainer for \"690c454b840a65ee01548092470efe5426b490c5788de4f25ce102f3012f335e\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.514035 1593 scope.go:117] "RemoveContainer" containerID="7289a00b26c66352cc501e01de184ae56fd127384183a260eed03f1cb5fcf6e5" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.514127 1593 reconciler.go:26] "Reconciler: start to sync state" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.515943 1593 setters.go:600] "Node became not ready" node="kc05" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2024-09-30T07:18:36Z","lastTransitionTime":"2024-09-30T07:18:36Z","reason":"KubeletNotReady","message":"PLEG is not healthy: pleg has yet to be successful"} Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.553985748Z" level=info msg="RemoveContainer for \"7289a00b26c66352cc501e01de184ae56fd127384183a260eed03f1cb5fcf6e5\"" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.619405 1593 kubelet_node_status.go:72] "Attempting to register node" node="kc05" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.636101736Z" level=info msg="RemoveContainer for \"7289a00b26c66352cc501e01de184ae56fd127384183a260eed03f1cb5fcf6e5\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.636374 1593 scope.go:117] "RemoveContainer" containerID="7fc2852c5e90b54d045bad70322f242e4f89a8ecd3ddf756ab5be65a9b3de297" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.648199 1593 kubelet_node_status.go:111] "Node was previously registered" node="kc05" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.648324 1593 kubelet_node_status.go:75] "Successfully registered node" node="kc05" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.650428 1593 setters.go:600] "Node became not ready" node="kc05" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2024-09-30T07:18:36Z","lastTransitionTime":"2024-09-30T07:18:36Z","reason":"KubeletNotReady","message":"PLEG is not healthy: pleg has yet to be successful"} Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.662910549Z" level=info msg="RemoveContainer for \"7fc2852c5e90b54d045bad70322f242e4f89a8ecd3ddf756ab5be65a9b3de297\"" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.732726989Z" level=info msg="RemoveContainer for \"7fc2852c5e90b54d045bad70322f242e4f89a8ecd3ddf756ab5be65a9b3de297\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.733170 1593 scope.go:117] "RemoveContainer" containerID="044bfa41d9509651cc472b9ac1764eeba41b04c5ab1c991355c87ed6df850818" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.737257431Z" level=info msg="RemoveContainer for \"044bfa41d9509651cc472b9ac1764eeba41b04c5ab1c991355c87ed6df850818\"" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.786707619Z" level=info msg="RemoveContainer for \"044bfa41d9509651cc472b9ac1764eeba41b04c5ab1c991355c87ed6df850818\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.786965 1593 scope.go:117] "RemoveContainer" containerID="d871b119883c9dbf93166db86999f0960ea85ea47e2e4d1c12f144a09f6ed17d" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.797549368Z" level=info msg="RemoveContainer for \"d871b119883c9dbf93166db86999f0960ea85ea47e2e4d1c12f144a09f6ed17d\"" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.837345911Z" level=info msg="RemoveContainer for \"d871b119883c9dbf93166db86999f0960ea85ea47e2e4d1c12f144a09f6ed17d\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.837637 1593 scope.go:117] "RemoveContainer" containerID="8c0dca9a9be4b0c8b4a174a9d550d1b83b9e0ed68cd0be144283cf2f59c80901" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.844177832Z" level=info msg="RemoveContainer for \"8c0dca9a9be4b0c8b4a174a9d550d1b83b9e0ed68cd0be144283cf2f59c80901\"" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.927645606Z" level=info msg="RemoveContainer for \"8c0dca9a9be4b0c8b4a174a9d550d1b83b9e0ed68cd0be144283cf2f59c80901\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.927868 1593 scope.go:117] "RemoveContainer" containerID="a91244c157e93697c351dd41d3eef894d89176ac62aeef0a799f0059948aec10" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.929795152Z" level=info msg="RemoveContainer for \"a91244c157e93697c351dd41d3eef894d89176ac62aeef0a799f0059948aec10\"" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.991603211Z" level=info msg="RemoveContainer for \"a91244c157e93697c351dd41d3eef894d89176ac62aeef0a799f0059948aec10\" returns successfully" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.991873 1593 scope.go:117] "RemoveContainer" containerID="5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30" Sep 30 07:18:36 kc05 containerd[1478]: time="2024-09-30T07:18:36.993562953Z" level=info msg="RemoveContainer for \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\"" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.994683 1593 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.996972 1593 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.997015 1593 status_manager.go:217] "Starting to sync pod status with apiserver" Sep 30 07:18:36 kc05 kubelet[1593]: I0930 07:18:36.997044 1593 kubelet.go:2321] "Starting kubelet main sync loop" Sep 30 07:18:36 kc05 kubelet[1593]: E0930 07:18:36.997105 1593 kubelet.go:2345] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.038762034Z" level=info msg="RemoveContainer for \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\" returns successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.039048 1593 scope.go:117] "RemoveContainer" containerID="6f24fb78ee56773e735673df6f77436a823e460e52a5d2a230023a7c167cb94e" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.070574924Z" level=info msg="RemoveContainer for \"6f24fb78ee56773e735673df6f77436a823e460e52a5d2a230023a7c167cb94e\"" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.095214 1593 kubelet_node_status.go:488] "Fast updating node status as it just became ready" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.097308 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.097345 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f64cad1e9ba4277e027f10993c4418795012d338fd1f6f2c338ebf3db4499284" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.097379 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.097404 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee5a0dd149541aa6c9f04af78b651d9472fbd7fb5e37aca1c344aab4a9ae0d5b" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.162491 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.162541 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.162596 1593 scope.go:117] "RemoveContainer" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.164650801Z" level=info msg="RemoveContainer for \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.174824049Z" level=info msg="RemoveContainer for \"6f24fb78ee56773e735673df6f77436a823e460e52a5d2a230023a7c167cb94e\" returns successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.175127 1593 scope.go:117] "RemoveContainer" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.176682625Z" level=info msg="RemoveContainer for \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.176912414Z" level=error msg="RemoveContainer for \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\" failed" error="failed to set removing state for container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": container is already in removing state" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.177134 1593 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to set removing state for container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": container is already in removing state" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.177172 1593 kuberuntime_gc.go:150] "Failed to remove container" err="rpc error: code = Unknown desc = failed to set removing state for container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": container is already in removing state" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.177198 1593 scope.go:117] "RemoveContainer" containerID="c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.178701662Z" level=info msg="RemoveContainer for \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\"" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.244069 1593 apiserver.go:52] "Watching apiserver" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.255776 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.255815 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.256481326Z" level=info msg="RemoveContainer for \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\" returns successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.256734 1593 scope.go:117] "RemoveContainer" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.257154899Z" level=error msg="ContainerStatus for \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.257486 1593 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": not found" containerID="d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.257561 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f"} err="failed to get container status \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": rpc error: code = NotFound desc = an error occurred when try to find container \"d5d05e478cda178fbb9280591c1f1c7e4a8d50119fdb793aa28219c15ba10b4f\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.257665 1593 scope.go:117] "RemoveContainer" containerID="5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.258018783Z" level=error msg="ContainerStatus for \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.258242 1593 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": not found" containerID="5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.258289 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30"} err="failed to get container status \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": rpc error: code = NotFound desc = an error occurred when try to find container \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.258334 1593 scope.go:117] "RemoveContainer" containerID="5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.258674587Z" level=error msg="ContainerStatus for \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.258894 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30"} err="failed to get container status \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": rpc error: code = NotFound desc = an error occurred when try to find container \"5db07c797cf81fa202f79d08cb1a8699027d6e3f499ae3403ab0e0fd70503a30\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.258937 1593 scope.go:117] "RemoveContainer" containerID="c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.260065000Z" level=info msg="RemoveContainer for \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.260188081Z" level=error msg="RemoveContainer for \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\" failed" error="failed to set removing state for container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": container is already in removing state" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.260302 1593 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to set removing state for container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": container is already in removing state" containerID="c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.260331 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc"} err="rpc error: code = Unknown desc = failed to set removing state for container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": container is already in removing state" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.260353 1593 scope.go:117] "RemoveContainer" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.261451700Z" level=info msg="RemoveContainer for \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\"" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.275789 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.275826 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.287534274Z" level=info msg="RemoveContainer for \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\" returns successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.287820 1593 scope.go:117] "RemoveContainer" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-burstable-poda2e9d01b_4bfa_446d_9897_71be4ebadea1.slice - libcontainer container kubepods-burstable-poda2e9d01b_4bfa_446d_9897_71be4ebadea1.slice. Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.289821916Z" level=info msg="RemoveContainer for \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.290077230Z" level=error msg="RemoveContainer for \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\" failed" error="failed to set removing state for container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": container is already in removing state" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.290322 1593 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to set removing state for container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": container is already in removing state" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.290395 1593 kuberuntime_gc.go:150] "Failed to remove container" err="rpc error: code = Unknown desc = failed to set removing state for container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": container is already in removing state" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.293662704Z" level=info msg="StopPodSandbox for \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.293757161Z" level=info msg="TearDown network for sandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.293774767Z" level=info msg="StopPodSandbox for \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.294182024Z" level=info msg="RemovePodSandbox for \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.294218857Z" level=info msg="Forcibly stopping sandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.294325743Z" level=info msg="TearDown network for sandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\" successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.295042 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.295078 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.301444 1593 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-besteffort-pod0344fcf8_42dc_437f_a79a_7b6dbd23ab99.slice - libcontainer container kubepods-besteffort-pod0344fcf8_42dc_437f_a79a_7b6dbd23ab99.slice. Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.319167 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-burstable-pod851b5147_7511_4641_91f3_1e01dd5fdb50.slice - libcontainer container kubepods-burstable-pod851b5147_7511_4641_91f3_1e01dd5fdb50.slice. Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331410 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sysfs\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-sysfs\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331544 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2e9d01b-4bfa-446d-9897-71be4ebadea1-root\") pod \"prometheus-node-exporter-mdpwn\" (UID: \"a2e9d01b-4bfa-446d-9897-71be4ebadea1\") " pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331649 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pods\" (UniqueName: \"kubernetes.io/host-path/851b5147-7511-4641-91f3-1e01dd5fdb50-pods\") pod \"loki-promtail-wghkq\" (UID: \"851b5147-7511-4641-91f3-1e01dd5fdb50\") " pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331741 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"devfs\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-devfs\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331838 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2e9d01b-4bfa-446d-9897-71be4ebadea1-proc\") pod \"prometheus-node-exporter-mdpwn\" (UID: \"a2e9d01b-4bfa-446d-9897-71be4ebadea1\") " pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.331960 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-plugins-dir\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332043 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"directpv-common-root\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-directpv-common-root\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332104 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"devfs\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-devfs\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332159 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-udev-data-dir\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-run-udev-data-dir\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332410 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0344fcf8-42dc-437f-a79a-7b6dbd23ab99-lib-modules\") pod \"kube-proxy-qmm2l\" (UID: \"0344fcf8-42dc-437f-a79a-7b6dbd23ab99\") " pod="kube-system/kube-proxy-qmm2l" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332486 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-mountpoint-dir\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332568 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-udev-data-dir\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-run-udev-data-dir\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332641 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"direct-csi-common-root\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-direct-csi-common-root\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332711 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-plugin\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni-plugin\") pod \"kube-flannel-ds-v97wm\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " pod="kube-flannel/kube-flannel-ds-v97wm" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332809 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2e9d01b-4bfa-446d-9897-71be4ebadea1-sys\") pod \"prometheus-node-exporter-mdpwn\" (UID: \"a2e9d01b-4bfa-446d-9897-71be4ebadea1\") " pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.332871 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-socket-dir\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.332923 1593 configmap.go:193] Couldn't get configMap kube-flannel/kube-flannel-cfg: object "kube-flannel"/"kube-flannel-cfg" not registered Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333013 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-plugins-dir\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.333059 1593 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05076276-0f40-42f8-9fde-88caea2027b7-flannel-cfg podName:05076276-0f40-42f8-9fde-88caea2027b7 nodeName:}" failed. No retries permitted until 2024-09-30 07:18:37.833018801 +0000 UTC m=+2.308608944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "flannel-cfg" (UniqueName: "kubernetes.io/configmap/05076276-0f40-42f8-9fde-88caea2027b7-flannel-cfg") pod "kube-flannel-ds-v97wm" (UID: "05076276-0f40-42f8-9fde-88caea2027b7") : object "kube-flannel"/"kube-flannel-cfg" not registered Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333094 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sentinel\" (UniqueName: \"kubernetes.io/host-path/4068edf6-a44a-460e-aab4-aac9ad87c23c-sentinel\") pod \"kured-gk6ff\" (UID: \"4068edf6-a44a-460e-aab4-aac9ad87c23c\") " pod="kube-system/kured-gk6ff" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333158 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"containers\" (UniqueName: \"kubernetes.io/host-path/851b5147-7511-4641-91f3-1e01dd5fdb50-containers\") pod \"loki-promtail-wghkq\" (UID: \"851b5147-7511-4641-91f3-1e01dd5fdb50\") " pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333227 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-socket-dir\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333286 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-registration-dir\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333340 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni\") pod \"kube-flannel-ds-v97wm\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " pod="kube-flannel/kube-flannel-ds-v97wm" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333394 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-xtables-lock\") pod \"kube-flannel-ds-v97wm\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " pod="kube-flannel/kube-flannel-ds-v97wm" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333487 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"direct-csi-common-root\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-direct-csi-common-root\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333544 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-mountpoint-dir\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333599 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5c37209-3eda-4a25-aec1-2449ac6ac6f5-registration-dir\") pod \"node-server-gs7wg\" (UID: \"d5c37209-3eda-4a25-aec1-2449ac6ac6f5\") " pod="directpv/node-server-gs7wg" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333653 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/0344fcf8-42dc-437f-a79a-7b6dbd23ab99-xtables-lock\") pod \"kube-proxy-qmm2l\" (UID: \"0344fcf8-42dc-437f-a79a-7b6dbd23ab99\") " pod="kube-system/kube-proxy-qmm2l" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333723 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/851b5147-7511-4641-91f3-1e01dd5fdb50-run\") pod \"loki-promtail-wghkq\" (UID: \"851b5147-7511-4641-91f3-1e01dd5fdb50\") " pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333786 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"directpv-common-root\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-directpv-common-root\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333850 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sysfs\" (UniqueName: \"kubernetes.io/host-path/8a78aeaf-f234-4b2a-a18c-54259e81dfa1-sysfs\") pod \"legacy-node-server-z9bps\" (UID: \"8a78aeaf-f234-4b2a-a18c-54259e81dfa1\") " pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.333943 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-run\") pod \"kube-flannel-ds-v97wm\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " pod="kube-flannel/kube-flannel-ds-v97wm" Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-besteffort-pod8a78aeaf_f234_4b2a_a18c_54259e81dfa1.slice - libcontainer container kubepods-besteffort-pod8a78aeaf_f234_4b2a_a18c_54259e81dfa1.slice. Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.347184 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.350692 1593 projected.go:288] Couldn't get configMap kube-flannel/kube-root-ca.crt: object "kube-flannel"/"kube-root-ca.crt" not registered Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.350733 1593 projected.go:194] Error preparing data for projected volume kube-api-access-w2dls for pod kube-flannel/kube-flannel-ds-v97wm: object "kube-flannel"/"kube-root-ca.crt" not registered Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.350855 1593 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05076276-0f40-42f8-9fde-88caea2027b7-kube-api-access-w2dls podName:05076276-0f40-42f8-9fde-88caea2027b7 nodeName:}" failed. No retries permitted until 2024-09-30 07:18:37.850819523 +0000 UTC m=+2.326409660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2dls" (UniqueName: "kubernetes.io/projected/05076276-0f40-42f8-9fde-88caea2027b7-kube-api-access-w2dls") pod "kube-flannel-ds-v97wm" (UID: "05076276-0f40-42f8-9fde-88caea2027b7") : object "kube-flannel"/"kube-root-ca.crt" not registered Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-besteffort-podd5c37209_3eda_4a25_aec1_2449ac6ac6f5.slice - libcontainer container kubepods-besteffort-podd5c37209_3eda_4a25_aec1_2449ac6ac6f5.slice. Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-besteffort-pod4068edf6_a44a_460e_aab4_aac9ad87c23c.slice - libcontainer container kubepods-besteffort-pod4068edf6_a44a_460e_aab4_aac9ad87c23c.slice. Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.375077 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.409044 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.446901 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.452057 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f24fb78ee56773e735673df6f77436a823e460e52a5d2a230023a7c167cb94e" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.452135 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.452168 1593 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f" Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.474247 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 systemd[1]: Created slice kubepods-burstable-pod05076276_0f40_42f8_9fde_88caea2027b7.slice - libcontainer container kubepods-burstable-pod05076276_0f40_42f8_9fde_88caea2027b7.slice. Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.505320 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.549903747Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.550119470Z" level=info msg="RemovePodSandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.550958271Z" level=info msg="StopPodSandbox for \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.551182686Z" level=info msg="TearDown network for sandbox \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.551218805Z" level=info msg="StopPodSandbox for \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.551837369Z" level=info msg="RemovePodSandbox for \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.551911621Z" level=info msg="Forcibly stopping sandbox \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.552120365Z" level=info msg="TearDown network for sandbox \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.602619704Z" level=info msg="StopPodSandbox for \"ee5a0dd149541aa6c9f04af78b651d9472fbd7fb5e37aca1c344aab4a9ae0d5b\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.602728858Z" level=info msg="Container to stop \"4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.602913244Z" level=info msg="TearDown network for sandbox \"ee5a0dd149541aa6c9f04af78b651d9472fbd7fb5e37aca1c344aab4a9ae0d5b\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.602946355Z" level=info msg="StopPodSandbox for \"ee5a0dd149541aa6c9f04af78b651d9472fbd7fb5e37aca1c344aab4a9ae0d5b\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.603528346Z" level=info msg="StopPodSandbox for \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.603759809Z" level=info msg="TearDown network for sandbox \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.603797683Z" level=info msg="StopPodSandbox for \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.604815807Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:prometheus-node-exporter-mdpwn,Uid:a2e9d01b-4bfa-446d-9897-71be4ebadea1,Namespace:dxinf-monitoring,Attempt:9,}" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.618909131Z" level=info msg="RemoveContainer for \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\" returns successfully" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.619172 1593 scope.go:117] "RemoveContainer" containerID="c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.619488580Z" level=error msg="ContainerStatus for \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.619711 1593 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": not found" containerID="c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.619763 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc"} err="failed to get container status \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": rpc error: code = NotFound desc = an error occurred when try to find container \"c9994c2638dc12f48d81240544a5ff193f2961877db09381c6d4394bf971cccc\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.619806 1593 scope.go:117] "RemoveContainer" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.620121143Z" level=error msg="ContainerStatus for \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": not found" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.620382 1593 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": not found" containerID="20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335" Sep 30 07:18:37 kc05 kubelet[1593]: I0930 07:18:37.620428 1593 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335"} err="failed to get container status \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": rpc error: code = NotFound desc = an error occurred when try to find container \"20ccfe97113c2c6d7b755ee6e9820edd376c6a4f5c45510b46d22adc8a804335\": not found" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.620706025Z" level=info msg="StopPodSandbox for \"f64cad1e9ba4277e027f10993c4418795012d338fd1f6f2c338ebf3db4499284\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.620764515Z" level=info msg="Container to stop \"0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.620921158Z" level=info msg="TearDown network for sandbox \"f64cad1e9ba4277e027f10993c4418795012d338fd1f6f2c338ebf3db4499284\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.620947273Z" level=info msg="StopPodSandbox for \"f64cad1e9ba4277e027f10993c4418795012d338fd1f6f2c338ebf3db4499284\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.621370496Z" level=info msg="StopPodSandbox for \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.621489320Z" level=info msg="TearDown network for sandbox \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.621516663Z" level=info msg="StopPodSandbox for \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" returns successfully" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.622256112Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-qmm2l,Uid:0344fcf8-42dc-437f-a79a-7b6dbd23ab99,Namespace:kube-system,Attempt:9,}" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.641205218Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.641281959Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.648836903Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.648951251Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.649047293Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.649101532Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.669764422Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.669868452Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.669956467Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.670036622Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.670074741Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.690757899Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:18:37 kc05 containerd[1478]: time="2024-09-30T07:18:37.690853601Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:37 kc05 kubelet[1593]: W0930 07:18:37.731843 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:18:37 kc05 kubelet[1593]: E0930 07:18:37.731914 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.079943129Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.080094803Z" level=info msg="Container to stop \"fc282cc46b77c579f9e1d568ccd3b67d1cd6cf072478d1f57301c9ca72a587fe\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.080188192Z" level=info msg="Container to stop \"c660541082541598fbc269ad8dd987d23ab2d957b6d4dcbc33f295269bfbf68d\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.080224783Z" level=info msg="Container to stop \"ba1e62942dbd3e328c57b25afc68812558508a7185d230165e704a6922b29581\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.080374619Z" level=info msg="TearDown network for sandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.080407968Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.081024596Z" level=info msg="StopPodSandbox for \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.081146584Z" level=error msg="StopPodSandbox for \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\": not found" Sep 30 07:18:38 kc05 kubelet[1593]: E0930 07:18:38.081358 1593 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794\": not found" podSandboxID="9106fde5776c04afd5e726d5549766b51c42b35f4af3b6371c7b042ccfa41794" Sep 30 07:18:38 kc05 kubelet[1593]: I0930 07:18:38.081428 1593 scope.go:117] "RemoveContainer" containerID="fc282cc46b77c579f9e1d568ccd3b67d1cd6cf072478d1f57301c9ca72a587fe" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.094049582Z" level=info msg="RemoveContainer for \"fc282cc46b77c579f9e1d568ccd3b67d1cd6cf072478d1f57301c9ca72a587fe\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.131830596Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.132070588Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.132673455Z" level=info msg="StopPodSandbox for \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133370992Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133419193Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133458791Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133523465Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133473115Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.133422073Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.134027105Z" level=info msg="StopPodSandbox for \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.134051456Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.134177631Z" level=info msg="StopPodSandbox for \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.142650077Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.142704572Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.142774027Z" level=info msg="TearDown network for sandbox \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.142823195Z" level=info msg="StopPodSandbox for \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.143394683Z" level=info msg="TearDown network for sandbox \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.143421815Z" level=info msg="StopPodSandbox for \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.143528126Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.143620161Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.144148050Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.155343770Z" level=info msg="TearDown network for sandbox \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.155401338Z" level=info msg="StopPodSandbox for \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.156159518Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.814133680Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.814282205Z" level=info msg="RemovePodSandbox \"bc6535c23f49ee4783455cd3dd381f51c569e4c1b53e77715fbd0907f08be1ae\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.815199601Z" level=info msg="StopPodSandbox for \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.824695220Z" level=info msg="TearDown network for sandbox \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.824731481Z" level=info msg="StopPodSandbox for \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" returns successfully" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.825197688Z" level=info msg="RemovePodSandbox for \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.825242580Z" level=info msg="Forcibly stopping sandbox \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\"" Sep 30 07:18:38 kc05 containerd[1478]: time="2024-09-30T07:18:38.833515229Z" level=info msg="TearDown network for sandbox \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.020442961Z" level=info msg="RemoveContainer for \"fc282cc46b77c579f9e1d568ccd3b67d1cd6cf072478d1f57301c9ca72a587fe\" returns successfully" Sep 30 07:18:39 kc05 kubelet[1593]: I0930 07:18:39.020852 1593 scope.go:117] "RemoveContainer" containerID="c660541082541598fbc269ad8dd987d23ab2d957b6d4dcbc33f295269bfbf68d" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.031793556Z" level=info msg="RemoveContainer for \"c660541082541598fbc269ad8dd987d23ab2d957b6d4dcbc33f295269bfbf68d\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.302709123Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.302841059Z" level=info msg="RemovePodSandbox \"47240bc0a047d343778f32450864051702044dc7dc8604b23db4a2474da59240\" returns successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.303496154Z" level=info msg="StopPodSandbox for \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.303688483Z" level=info msg="TearDown network for sandbox \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.303729570Z" level=info msg="StopPodSandbox for \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" returns successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.304279236Z" level=info msg="RemovePodSandbox for \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.304333395Z" level=info msg="Forcibly stopping sandbox \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.304475928Z" level=info msg="TearDown network for sandbox \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.752884135Z" level=info msg="RemoveContainer for \"c660541082541598fbc269ad8dd987d23ab2d957b6d4dcbc33f295269bfbf68d\" returns successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.753954438Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-flannel-ds-v97wm,Uid:05076276-0f40-42f8-9fde-88caea2027b7,Namespace:kube-flannel,Attempt:4,}" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.969254177Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.969400273Z" level=info msg="RemovePodSandbox \"da4112a06bf0c38c2fc8ab5cf55165a10d069c18e42ea60e56ffc0efa171520d\" returns successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.970187692Z" level=info msg="StopPodSandbox for \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.995684994Z" level=info msg="TearDown network for sandbox \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.995733288Z" level=info msg="StopPodSandbox for \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" returns successfully" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.996297534Z" level=info msg="RemovePodSandbox for \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\"" Sep 30 07:18:39 kc05 containerd[1478]: time="2024-09-30T07:18:39.996351613Z" level=info msg="Forcibly stopping sandbox \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\"" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.019075332Z" level=info msg="TearDown network for sandbox \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" successfully" Sep 30 07:18:40 kc05 kubelet[1593]: W0930 07:18:40.229407 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.229486 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342764540Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342834060Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342858365Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342814127Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342876703Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342904516Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342942795Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.342972823Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.366740833Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.366870977Z" level=info msg="RemovePodSandbox \"2af1514bb2ed3953dab814c8e180d7d7551049f986ccb238f557088903906417\" returns successfully" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.367488976Z" level=info msg="StopPodSandbox for \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\"" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.376764225Z" level=info msg="TearDown network for sandbox \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" successfully" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.376804788Z" level=info msg="StopPodSandbox for \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" returns successfully" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.377372290Z" level=info msg="RemovePodSandbox for \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\"" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.377420859Z" level=info msg="Forcibly stopping sandbox \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\"" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.386451630Z" level=info msg="TearDown network for sandbox \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" successfully" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.458644908Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.459001 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.459096 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.459125 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.459193 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.516160371Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.516518 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.516599 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.516643 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.516712 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.524431637Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"99eccf0ecd2fd9dd3eb38ad25e947b1b6c3d1d79015eec701a66a99387230a76\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.524671 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99eccf0ecd2fd9dd3eb38ad25e947b1b6c3d1d79015eec701a66a99387230a76\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.524749 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99eccf0ecd2fd9dd3eb38ad25e947b1b6c3d1d79015eec701a66a99387230a76\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.524783 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99eccf0ecd2fd9dd3eb38ad25e947b1b6c3d1d79015eec701a66a99387230a76\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.524855 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"99eccf0ecd2fd9dd3eb38ad25e947b1b6c3d1d79015eec701a66a99387230a76\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.566379731Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"24a109e93bc165a7b03237cfbc02af54d09b1f91cece59e12c47324dce7ece73\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.566738 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"24a109e93bc165a7b03237cfbc02af54d09b1f91cece59e12c47324dce7ece73\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.566830 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"24a109e93bc165a7b03237cfbc02af54d09b1f91cece59e12c47324dce7ece73\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.566872 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"24a109e93bc165a7b03237cfbc02af54d09b1f91cece59e12c47324dce7ece73\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.566943 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"24a109e93bc165a7b03237cfbc02af54d09b1f91cece59e12c47324dce7ece73\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:18:40 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e5e2e1512f27d702d7b321c0f6f475a2f29afa0cdc6181362d2ed9c68d2cc20e-shm.mount: Deactivated successfully. Sep 30 07:18:40 kc05 systemd[1]: run-netns-cni\x2d6d8fa34a\x2dadc2\x2d5be0\x2d1936\x2d2f41febef359.mount: Deactivated successfully. Sep 30 07:18:40 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-a1b62c12e0591a56325e47d35ebd116b534e1af9ec2fc54acdc775dc0d3f904d-shm.mount: Deactivated successfully. Sep 30 07:18:40 kc05 systemd[1]: Started cri-containerd-48248f102e0640f758af8257a37dbee6175de13fd87132fd398660ebd1c10045.scope - libcontainer container 48248f102e0640f758af8257a37dbee6175de13fd87132fd398660ebd1c10045. Sep 30 07:18:40 kc05 systemd[1]: Started cri-containerd-ce24468eec4743a22e327c21a28974dc36a2d41d6540d9c0c41ec7ef0c12ae64.scope - libcontainer container ce24468eec4743a22e327c21a28974dc36a2d41d6540d9c0c41ec7ef0c12ae64. Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.656235591Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.656394662Z" level=info msg="RemovePodSandbox \"cdc1623b30ca1b821cb8a62870c0f7541d623629c455ad028f0f0eec46c8274b\" returns successfully" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.696372746Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-qmm2l,Uid:0344fcf8-42dc-437f-a79a-7b6dbd23ab99,Namespace:kube-system,Attempt:9,} returns sandbox id \"48248f102e0640f758af8257a37dbee6175de13fd87132fd398660ebd1c10045\"" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.708919 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.710610 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.713219735Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.713307933Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.713346017Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.713374285Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:18:40 kc05 systemd[1]: Started cri-containerd-c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae.scope - libcontainer container c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae. Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.811524512Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-flannel-ds-v97wm,Uid:05076276-0f40-42f8-9fde-88caea2027b7,Namespace:kube-flannel,Attempt:4,} returns sandbox id \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\"" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.813682 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:40 kc05 kubelet[1593]: E0930 07:18:40.814882 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.871625052Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:prometheus-node-exporter-mdpwn,Uid:a2e9d01b-4bfa-446d-9897-71be4ebadea1,Namespace:dxinf-monitoring,Attempt:9,} returns sandbox id \"ce24468eec4743a22e327c21a28974dc36a2d41d6540d9c0c41ec7ef0c12ae64\"" Sep 30 07:18:40 kc05 containerd[1478]: time="2024-09-30T07:18:40.873864888Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.491686092Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.491743364Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 kubelet[1593]: E0930 07:18:41.495393 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:41 kc05 kubelet[1593]: E0930 07:18:41.496526 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:18:41 kc05 kubelet[1593]: I0930 07:18:41.496697 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:18:41 kc05 kubelet[1593]: E0930 07:18:41.496919 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500225822Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500369635Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500472544Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500559759Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500587306Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500613688Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.500357750Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.501245676Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.501644246Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.502448219Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.508361687Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.508395768Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.509149898Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.524401738Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.524447793Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:18:41 kc05 containerd[1478]: time="2024-09-30T07:18:41.525243447Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:18:41 kc05 kubelet[1593]: W0930 07:18:41.526403 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:41 kc05 kubelet[1593]: W0930 07:18:41.556365 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:41 kc05 kubelet[1593]: W0930 07:18:41.590073 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.215949925Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.216398 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.216521 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.216573 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.216668 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.275478845Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.275828 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.275929 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.275979 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.276087 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.381328361Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"1d34e828b7bb34fa9f18dcd9b3ec3fc9bfb26ec18e5aca33d2ee344e99777801\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.381661 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d34e828b7bb34fa9f18dcd9b3ec3fc9bfb26ec18e5aca33d2ee344e99777801\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.381749 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d34e828b7bb34fa9f18dcd9b3ec3fc9bfb26ec18e5aca33d2ee344e99777801\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.381797 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d34e828b7bb34fa9f18dcd9b3ec3fc9bfb26ec18e5aca33d2ee344e99777801\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.381886 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1d34e828b7bb34fa9f18dcd9b3ec3fc9bfb26ec18e5aca33d2ee344e99777801\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.406192880Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.420411793Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.426904240Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 1.552977228s" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.426966924Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.428018 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.429240 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:18:42 kc05 kubelet[1593]: I0930 07:18:42.502135 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.503537 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:42 kc05 containerd[1478]: time="2024-09-30T07:18:42.503643018Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:18:42 kc05 kubelet[1593]: E0930 07:18:42.504821 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:18:42 kc05 kubelet[1593]: W0930 07:18:42.535165 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:42 kc05 kubelet[1593]: W0930 07:18:42.535201 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:18:42 kc05 kubelet[1593]: W0930 07:18:42.564322 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:42 kc05 systemd[1]: run-netns-cni\x2d2ffdac2a\x2db4bc\x2d1153\x2d1ac5\x2db382ee4d0303.mount: Deactivated successfully. Sep 30 07:18:42 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-9bdc8c4ba0156fe66b84f4b238d72487f04da2873029ab28dbef063dc93b0d46-shm.mount: Deactivated successfully. Sep 30 07:18:42 kc05 systemd[1]: run-netns-cni\x2d5edc6fb0\x2db4ef\x2dee29\x2d29b7\x2df9fe36ebad27.mount: Deactivated successfully. Sep 30 07:18:42 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-66d2223255051a00a727d3a5a44c21105e89ca2dd56446e764a3903893d66293-shm.mount: Deactivated successfully. Sep 30 07:18:43 kc05 containerd[1478]: time="2024-09-30T07:18:43.252481282Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:18:43 kc05 containerd[1478]: time="2024-09-30T07:18:43.276202201Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:18:43 kc05 containerd[1478]: time="2024-09-30T07:18:43.284130558Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 780.440369ms" Sep 30 07:18:43 kc05 containerd[1478]: time="2024-09-30T07:18:43.284186471Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:18:43 kc05 kubelet[1593]: E0930 07:18:43.285310 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:43 kc05 kubelet[1593]: E0930 07:18:43.286525 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:18:44 kc05 kubelet[1593]: W0930 07:18:44.696169 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:18:44 kc05 kubelet[1593]: E0930 07:18:44.696231 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:18:44 kc05 containerd[1478]: time="2024-09-30T07:18:44.995603677Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:18:44 kc05 containerd[1478]: time="2024-09-30T07:18:44.995703671Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:44 kc05 containerd[1478]: time="2024-09-30T07:18:44.995792758Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:44 kc05 containerd[1478]: time="2024-09-30T07:18:44.995829083Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.005418170Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.005463467Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.005863103Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.015184584Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.015235577Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.015940950Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:18:45 kc05 kubelet[1593]: W0930 07:18:45.041643 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:45 kc05 systemd[1]: run-netns-cni\x2dd4d53f20\x2dea1b\x2d3d87\x2d0440\x2dffedbb7b516f.mount: Deactivated successfully. Sep 30 07:18:45 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3-shm.mount: Deactivated successfully. Sep 30 07:18:45 kc05 containerd[1478]: time="2024-09-30T07:18:45.146033906Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:45 kc05 kubelet[1593]: E0930 07:18:45.146352 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:45 kc05 kubelet[1593]: E0930 07:18:45.146442 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:45 kc05 kubelet[1593]: E0930 07:18:45.146488 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:45 kc05 kubelet[1593]: E0930 07:18:45.146567 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"877ec101ae7de71c187c39a727eaafdfe00b388cc57eae0863cd0143205df4b3\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.044573 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.080737 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.112901 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.145639 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.145667 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.172231 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.201355 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 kubelet[1593]: W0930 07:18:47.231787 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.393293683Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.393411725Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.393518703Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.393565971Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.402402524Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.402452341Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.403044975Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.412154637Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.412214242Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.413100604Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:18:47 kc05 systemd[1]: run-netns-cni\x2deabdde6a\x2df1ab\x2df709\x2d92a5\x2d73b44a438b12.mount: Deactivated successfully. Sep 30 07:18:47 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93-shm.mount: Deactivated successfully. Sep 30 07:18:47 kc05 containerd[1478]: time="2024-09-30T07:18:47.537800096Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:47 kc05 kubelet[1593]: E0930 07:18:47.538161 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:47 kc05 kubelet[1593]: E0930 07:18:47.538236 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:47 kc05 kubelet[1593]: E0930 07:18:47.538278 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:47 kc05 kubelet[1593]: E0930 07:18:47.538353 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"cfc94b6da0b1f095caf1dea83a2ed6b212d2b9de85cd754ab3eb31cc17544c93\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:18:51 kc05 kubelet[1593]: I0930 07:18:51.998778 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:18:52 kc05 kubelet[1593]: E0930 07:18:52.000198 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:52 kc05 kubelet[1593]: E0930 07:18:52.001431 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:18:52 kc05 kubelet[1593]: W0930 07:18:52.031110 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:52 kc05 kubelet[1593]: W0930 07:18:52.553811 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:18:52 kc05 kubelet[1593]: E0930 07:18:52.553876 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:18:53 kc05 containerd[1478]: time="2024-09-30T07:18:53.999345163Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:53.999444232Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:53.999529098Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:53.999564730Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:53.999599635Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.010519029Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.010571892Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.011283211Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:18:54 kc05 systemd[1]: run-netns-cni\x2d2b887f35\x2d3bde\x2db9f2\x2d0869\x2d51ca2d76a69a.mount: Deactivated successfully. Sep 30 07:18:54 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136-shm.mount: Deactivated successfully. Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.146349377Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:54 kc05 kubelet[1593]: E0930 07:18:54.146750 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:54 kc05 kubelet[1593]: E0930 07:18:54.146873 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:54 kc05 kubelet[1593]: E0930 07:18:54.146928 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:18:54 kc05 kubelet[1593]: E0930 07:18:54.147041 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b6b9f011a97f68deae0d6d3563c49746e730473209a483e7f1431ee383970136\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.998814863Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:18:54 kc05 containerd[1478]: time="2024-09-30T07:18:54.998919504Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:54 kc05 kubelet[1593]: E0930 07:18:54.999587 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:55 kc05 kubelet[1593]: E0930 07:18:55.000792 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:18:55 kc05 containerd[1478]: time="2024-09-30T07:18:55.008641914Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:18:55 kc05 containerd[1478]: time="2024-09-30T07:18:55.008690919Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:18:55 kc05 containerd[1478]: time="2024-09-30T07:18:55.009410623Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:18:55 kc05 systemd[1]: run-netns-cni\x2d0f16846a\x2dd62e\x2d8d07\x2d9490\x2d64183ce52622.mount: Deactivated successfully. Sep 30 07:18:55 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe-shm.mount: Deactivated successfully. Sep 30 07:18:55 kc05 containerd[1478]: time="2024-09-30T07:18:55.140627168Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:55 kc05 kubelet[1593]: E0930 07:18:55.141090 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:55 kc05 kubelet[1593]: E0930 07:18:55.141219 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:55 kc05 kubelet[1593]: E0930 07:18:55.141286 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:18:55 kc05 kubelet[1593]: E0930 07:18:55.141397 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"16e6857dd91e9a1eb29d1979093e88962208ba4c061b29dcd8830755787a87fe\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:18:55 kc05 kubelet[1593]: I0930 07:18:55.998377 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:18:56 kc05 containerd[1478]: time="2024-09-30T07:18:56.000051065Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:18:56 kc05 containerd[1478]: time="2024-09-30T07:18:56.588620204Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:18:56 kc05 containerd[1478]: time="2024-09-30T07:18:56.602896403Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:18:56 kc05 containerd[1478]: time="2024-09-30T07:18:56.608220418Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 608.097127ms" Sep 30 07:18:56 kc05 containerd[1478]: time="2024-09-30T07:18:56.608259076Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:18:56 kc05 kubelet[1593]: E0930 07:18:56.609554 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:18:56 kc05 kubelet[1593]: E0930 07:18:56.610872 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.007721490Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.007791765Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.029906856Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.029957220Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.030716159Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.048468 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.079602 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.114778 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.114812 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:18:57 kc05 systemd[1]: run-netns-cni\x2d4f7c68b8\x2d3236\x2d97b7\x2d45a4\x2da031d1407b2f.mount: Deactivated successfully. Sep 30 07:18:57 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692-shm.mount: Deactivated successfully. Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.146242 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 containerd[1478]: time="2024-09-30T07:18:57.170753730Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:57 kc05 kubelet[1593]: E0930 07:18:57.171159 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:57 kc05 kubelet[1593]: E0930 07:18:57.171264 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:57 kc05 kubelet[1593]: E0930 07:18:57.171315 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:18:57 kc05 kubelet[1593]: E0930 07:18:57.171407 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"89f8a6df7ad596b655ecfee7479eb597fde282cf057e06f48534c9d8a8b99692\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.177442 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.210015 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:57 kc05 kubelet[1593]: W0930 07:18:57.245324 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:18:58 kc05 containerd[1478]: time="2024-09-30T07:18:58.999475339Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:58.999595281Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:58.999687437Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:58.999731627Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.008079596Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.008126765Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.008591560Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.018053621Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.018111422Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.018910233Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:18:59 kc05 systemd[1]: run-netns-cni\x2d9e965012\x2d1e3e\x2defab\x2d39c5\x2dc0be09278de2.mount: Deactivated successfully. Sep 30 07:18:59 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52-shm.mount: Deactivated successfully. Sep 30 07:18:59 kc05 containerd[1478]: time="2024-09-30T07:18:59.163183030Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:59 kc05 kubelet[1593]: E0930 07:18:59.163577 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:18:59 kc05 kubelet[1593]: E0930 07:18:59.163705 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:59 kc05 kubelet[1593]: E0930 07:18:59.163762 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:18:59 kc05 kubelet[1593]: E0930 07:18:59.163864 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7f3d63c752d96495acb67e0068db9c0bec49abb290b4332dc7567c33af3a6d52\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:19:04 kc05 kubelet[1593]: I0930 07:19:04.998780 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:19:05 kc05 kubelet[1593]: E0930 07:19:05.000215 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:05 kc05 kubelet[1593]: E0930 07:19:05.001462 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:19:05 kc05 kubelet[1593]: W0930 07:19:05.027533 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: E0930 07:19:07.009546 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:07 kc05 kubelet[1593]: E0930 07:19:07.010820 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.036097 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.062674 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.089395 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.121787 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.156851 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.189700 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.222591 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:07 kc05 kubelet[1593]: W0930 07:19:07.222623 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:07 kc05 containerd[1478]: time="2024-09-30T07:19:07.998878037Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:19:07 kc05 containerd[1478]: time="2024-09-30T07:19:07.999022774Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.023613355Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.023667031Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.024518941Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:19:08 kc05 systemd[1]: run-netns-cni\x2d38cc90bd\x2d888d\x2de175\x2db778\x2d47ddbcac9364.mount: Deactivated successfully. Sep 30 07:19:08 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736-shm.mount: Deactivated successfully. Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.168593293Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:08 kc05 kubelet[1593]: E0930 07:19:08.169013 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:08 kc05 kubelet[1593]: E0930 07:19:08.169141 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:08 kc05 kubelet[1593]: E0930 07:19:08.169200 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:08 kc05 kubelet[1593]: E0930 07:19:08.169297 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"84cf6bdce158a007b7211d3bceeaf10a7e6d0c1d895fa89cade4748531f21736\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998335434Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998432823Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998600212Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998698681Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998790381Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998826376Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:08 kc05 containerd[1478]: time="2024-09-30T07:19:08.998868909Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.006873188Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.006912430Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.007571170Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.007678284Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.007726422Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.008327427Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:19:09 kc05 systemd[1]: run-netns-cni\x2d6bfa3784\x2d8841\x2d81f4\x2d02e3\x2dd21e08da99cc.mount: Deactivated successfully. Sep 30 07:19:09 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563-shm.mount: Deactivated successfully. Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.354177680Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.354571 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.354680 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.354737 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.354841 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"82251cb640286f1204305af12d261ac897a88a617b1736cd567b387b83e1c563\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:19:09 kc05 containerd[1478]: time="2024-09-30T07:19:09.402105384Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.402441 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.402537 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.402597 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.402684 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:19:09 kc05 kubelet[1593]: I0930 07:19:09.998762 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:19:09 kc05 kubelet[1593]: E0930 07:19:09.999078 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:19:10 kc05 systemd[1]: run-netns-cni\x2d06ec8553\x2d7cc9\x2db931\x2da8d7\x2d5ea8ce706295.mount: Deactivated successfully. Sep 30 07:19:10 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5b53d08928a3c991e9130f9e509ce5b7b4df163b569ceebfb707fed4adeb9961-shm.mount: Deactivated successfully. Sep 30 07:19:10 kc05 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Sep 30 07:19:10 kc05 systemd[1]: Started sshd@0-172.16.0.25:22-172.16.1.65:44522.service - OpenSSH per-connection server daemon (172.16.1.65:44522). Sep 30 07:19:10 kc05 sshd[2794]: Accepted publickey for core from 172.16.1.65 port 44522 ssh2: ED25519 SHA256:z/4KksGmKVQ0G7DEBs0q1kZ5uPGTiKjgpISdQb33QXU Sep 30 07:19:10 kc05 sshd[2794]: pam_unix(sshd:session): session opened for user core(uid=500) by (uid=0) Sep 30 07:19:10 kc05 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Sep 30 07:19:10 kc05 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Sep 30 07:19:10 kc05 systemd-logind[1453]: New session 1 of user core. Sep 30 07:19:10 kc05 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Sep 30 07:19:10 kc05 systemd[1]: Starting user@500.service - User Manager for UID 500... Sep 30 07:19:10 kc05 (systemd)[2799]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Sep 30 07:19:11 kc05 systemd[2799]: Queued start job for default target default.target. Sep 30 07:19:11 kc05 systemd[2799]: Created slice app.slice - User Application Slice. Sep 30 07:19:11 kc05 systemd[2799]: Reached target paths.target - Paths. Sep 30 07:19:11 kc05 systemd[2799]: Reached target timers.target - Timers. Sep 30 07:19:11 kc05 systemd[2799]: Starting dbus.socket - D-Bus User Message Bus Socket... Sep 30 07:19:11 kc05 systemd[2799]: Listening on dbus.socket - D-Bus User Message Bus Socket. Sep 30 07:19:11 kc05 systemd[2799]: Reached target sockets.target - Sockets. Sep 30 07:19:11 kc05 systemd[2799]: Reached target basic.target - Basic System. Sep 30 07:19:11 kc05 systemd[2799]: Reached target default.target - Main User Target. Sep 30 07:19:11 kc05 systemd[2799]: Startup finished in 308ms. Sep 30 07:19:11 kc05 systemd[1]: Started user@500.service - User Manager for UID 500. Sep 30 07:19:11 kc05 systemd[1]: Started session-1.scope - Session 1 of User core. Sep 30 07:19:11 kc05 containerd[1478]: time="2024-09-30T07:19:11.998792429Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:19:11 kc05 containerd[1478]: time="2024-09-30T07:19:11.998892720Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:11 kc05 containerd[1478]: time="2024-09-30T07:19:11.998977263Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:11 kc05 containerd[1478]: time="2024-09-30T07:19:11.999034587Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.009296100Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.009349614Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.009891428Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.018039027Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.018088263Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.018887451Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:19:12 kc05 systemd[1]: run-netns-cni\x2d560832e5\x2d3807\x2d1f6d\x2d52e6\x2daab81162de08.mount: Deactivated successfully. Sep 30 07:19:12 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf-shm.mount: Deactivated successfully. Sep 30 07:19:12 kc05 containerd[1478]: time="2024-09-30T07:19:12.152123105Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:12 kc05 kubelet[1593]: E0930 07:19:12.152515 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:12 kc05 kubelet[1593]: E0930 07:19:12.152630 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:12 kc05 kubelet[1593]: E0930 07:19:12.152685 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:12 kc05 kubelet[1593]: E0930 07:19:12.152778 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c8e8c92dfb2a5ef1c3d8add56e6941f065a644351d0cb914a9f9206fcec0eecf\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:19:16 kc05 kubelet[1593]: W0930 07:19:16.318481 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:19:16 kc05 kubelet[1593]: E0930 07:19:16.318556 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:19:17 kc05 update_engine[1468]: I0930 07:19:17.008100 1468 update_attempter.cc:509] Updating boot flags... Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.036186 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.070151 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.070182 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.095661 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.120068 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.147668 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kernel: BTRFS warning: duplicate device /dev/sda4 devid 1 generation 33 scanned by (udev-worker) (2882) Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.180022 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kubelet[1593]: W0930 07:19:17.210484 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:17 kc05 kernel: BTRFS warning: duplicate device /dev/sda4 devid 1 generation 33 scanned by (udev-worker) (2876) Sep 30 07:19:19 kc05 kubelet[1593]: I0930 07:19:19.998665 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:19:20 kc05 kubelet[1593]: E0930 07:19:20.000136 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:20 kc05 kubelet[1593]: E0930 07:19:20.001360 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:19:20 kc05 kubelet[1593]: I0930 07:19:20.998568 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:19:20 kc05 containerd[1478]: time="2024-09-30T07:19:20.999197959Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:20.999313802Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.000356727Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.021214589Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.021279085Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.022027254Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:19:21 kc05 kubelet[1593]: W0930 07:19:21.028536 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:21 kc05 systemd[1]: run-netns-cni\x2ddf88641b\x2d4046\x2d6a42\x2daa44\x2dbe91e1602dd4.mount: Deactivated successfully. Sep 30 07:19:21 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb-shm.mount: Deactivated successfully. Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.197299794Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.197647 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.197740 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.197782 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.197858 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fde274359d3ff30a5a41c3e4c712f5c8a9138fce778b9ce4b9af78deb4503ecb\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.616357461Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.630575425Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.637272430Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 636.844981ms" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.637322383Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.638381 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:21 kc05 kubelet[1593]: E0930 07:19:21.639638 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.998764069Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.998867388Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.998970677Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.999037673Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:21 kc05 containerd[1478]: time="2024-09-30T07:19:21.999085638Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:21.999858 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:22.001057 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:19:22 kc05 containerd[1478]: time="2024-09-30T07:19:22.008518802Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:19:22 kc05 containerd[1478]: time="2024-09-30T07:19:22.008575456Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:19:22 kc05 containerd[1478]: time="2024-09-30T07:19:22.009528934Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:19:22 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22-shm.mount: Deactivated successfully. Sep 30 07:19:22 kc05 containerd[1478]: time="2024-09-30T07:19:22.135637039Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:22.136016 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:22.136093 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:22.136130 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:22 kc05 kubelet[1593]: E0930 07:19:22.136192 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8651372e10ad9f4c5db64ed29740b4bbd7e21835f5f81612e7efee617ead6e22\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999047554Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999146264Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999243316Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999280480Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999223597Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:19:24 kc05 containerd[1478]: time="2024-09-30T07:19:24.999466301Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010082188Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010130776Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010098950Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010238438Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010561698Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.010788306Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.020312068Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.020375706Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.021417998Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:19:25 kc05 systemd[1]: run-netns-cni\x2d96a6d6ff\x2d11ef\x2da504\x2d7b55\x2d733122563470.mount: Deactivated successfully. Sep 30 07:19:25 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6-shm.mount: Deactivated successfully. Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.341121164Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.341540 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.341663 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.341716 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.341809 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1e5a4bdc08323d86fb7014326b507887a1f183ef3043cec6debfb29d8f2afed6\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:19:25 kc05 containerd[1478]: time="2024-09-30T07:19:25.397304953Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.397682 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.397770 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.397821 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:25 kc05 kubelet[1593]: E0930 07:19:25.397906 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:19:26 kc05 systemd[1]: run-netns-cni\x2d4f9ad682\x2dd578\x2d5966\x2dd800\x2df2b45de68886.mount: Deactivated successfully. Sep 30 07:19:26 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-7da80fc0ff719c5075a71d665f232bc21c92b89380f9e32c34c3264c1ae7e9cb-shm.mount: Deactivated successfully. Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.037188 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.069447 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.104285 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.142497 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.173191 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.207790 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.207820 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:27 kc05 kubelet[1593]: W0930 07:19:27.241360 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:32 kc05 kubelet[1593]: I0930 07:19:32.998887 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:19:32 kc05 kubelet[1593]: E0930 07:19:32.999262 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:19:33 kc05 kubelet[1593]: W0930 07:19:33.031522 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:34 kc05 kubelet[1593]: I0930 07:19:34.998365 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:19:34 kc05 kubelet[1593]: E0930 07:19:34.998672 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:19:34 kc05 kubelet[1593]: E0930 07:19:34.999652 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:35 kc05 kubelet[1593]: E0930 07:19:35.000855 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:19:35 kc05 containerd[1478]: time="2024-09-30T07:19:35.999202818Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:35.999302760Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:35.999397728Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:35.999442361Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:35.999411487Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:35.999640503Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.009065972Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.009120923Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.009664860Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.018251022Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.018292839Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.018964927Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.022669516Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.022714592Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.023486638Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:19:36 kc05 systemd[1]: run-netns-cni\x2d3987f06a\x2d196b\x2d4f6f\x2d929f\x2dd776befbd731.mount: Deactivated successfully. Sep 30 07:19:36 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa-shm.mount: Deactivated successfully. Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.412596518Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.413029 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.413137 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.413180 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.413264 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ab5caea03b549966bb7dd311e5852629b6393f7a01c189ac60790d4d4b4498fa\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:19:36 kc05 containerd[1478]: time="2024-09-30T07:19:36.496022278Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.496382 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.496478 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.496527 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:36 kc05 kubelet[1593]: E0930 07:19:36.496617 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.005254024Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.005322971Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.005389652Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.005417782Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.005445259Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.014604526Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.014655133Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.015402982Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.047728 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.074917 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.102119 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.102143 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.128535 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.155724 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.184374 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:37 kc05 containerd[1478]: time="2024-09-30T07:19:37.188805001Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"ec915defc297622cade6552e5d5a9cb04d5258818e7006cd432d4c364912728f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:37 kc05 kubelet[1593]: E0930 07:19:37.189222 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec915defc297622cade6552e5d5a9cb04d5258818e7006cd432d4c364912728f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:37 kc05 kubelet[1593]: E0930 07:19:37.189323 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec915defc297622cade6552e5d5a9cb04d5258818e7006cd432d4c364912728f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:37 kc05 kubelet[1593]: E0930 07:19:37.189375 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec915defc297622cade6552e5d5a9cb04d5258818e7006cd432d4c364912728f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:37 kc05 kubelet[1593]: E0930 07:19:37.189462 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ec915defc297622cade6552e5d5a9cb04d5258818e7006cd432d4c364912728f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:19:37 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-1b16d8a11a974e2eac912fcde9c5f3eb6d730ec31e3771df457da67f393260f7-shm.mount: Deactivated successfully. Sep 30 07:19:37 kc05 kubelet[1593]: W0930 07:19:37.217047 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:38 kc05 containerd[1478]: time="2024-09-30T07:19:38.998966510Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:19:38 kc05 containerd[1478]: time="2024-09-30T07:19:38.999105723Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:39 kc05 containerd[1478]: time="2024-09-30T07:19:39.008170504Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:19:39 kc05 containerd[1478]: time="2024-09-30T07:19:39.008222217Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:19:39 kc05 containerd[1478]: time="2024-09-30T07:19:39.008986922Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:19:39 kc05 systemd[1]: run-netns-cni\x2de3bf9282\x2dfa99\x2d4b7c\x2d81f8\x2db5065beb18c1.mount: Deactivated successfully. Sep 30 07:19:39 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c-shm.mount: Deactivated successfully. Sep 30 07:19:39 kc05 containerd[1478]: time="2024-09-30T07:19:39.184700276Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:39 kc05 kubelet[1593]: E0930 07:19:39.185119 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:39 kc05 kubelet[1593]: E0930 07:19:39.185231 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:39 kc05 kubelet[1593]: E0930 07:19:39.185285 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:39 kc05 kubelet[1593]: E0930 07:19:39.185379 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"558b119288b74e0ad75c16954d7de8c7f7accf94b38aafa9dbb54e078097110c\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.716638569Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.725585439Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.725654131Z" level=info msg="StopPodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.726314486Z" level=info msg="RemovePodSandbox for \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.726434391Z" level=info msg="Forcibly stopping sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\"" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.736516131Z" level=info msg="TearDown network for sandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" successfully" Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.785625280Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:19:40 kc05 containerd[1478]: time="2024-09-30T07:19:40.785753163Z" level=info msg="RemovePodSandbox \"c97d83992cbfca823630dd02a90f6bd0e275780059ece3a9be631bdcec04d4f4\" returns successfully" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.044976 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.080946 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.111087 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.145924 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.145948 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.178145 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.206206 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: W0930 07:19:47.237680 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:47 kc05 kubelet[1593]: I0930 07:19:47.998427 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:19:47 kc05 kubelet[1593]: E0930 07:19:47.998725 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:19:48 kc05 kubelet[1593]: W0930 07:19:48.031067 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:48 kc05 kubelet[1593]: W0930 07:19:48.489027 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:19:48 kc05 kubelet[1593]: E0930 07:19:48.489096 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:19:49 kc05 sudo[3336]: core : TTY=pts/0 ; PWD=/root ; USER=root ; COMMAND=/bin/bash Sep 30 07:19:49 kc05 sudo[3336]: pam_unix(sudo-i:session): session opened for user root(uid=0) by core(uid=500) Sep 30 07:19:49 kc05 kubelet[1593]: I0930 07:19:49.998235 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:19:49 kc05 kubelet[1593]: E0930 07:19:49.998549 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:19:49 kc05 containerd[1478]: time="2024-09-30T07:19:49.998878151Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:19:49 kc05 containerd[1478]: time="2024-09-30T07:19:49.999023900Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.000212 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.001411 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.022453496Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.022520986Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.023417813Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:19:50 kc05 kubelet[1593]: W0930 07:19:50.027635 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:50 kc05 systemd[1]: run-netns-cni\x2d12c0cae1\x2d6cd8\x2dcba8\x2dbd90\x2d5b274f13cde0.mount: Deactivated successfully. Sep 30 07:19:50 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221-shm.mount: Deactivated successfully. Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.206319099Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.206690 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.206783 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.206824 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:19:50 kc05 kubelet[1593]: E0930 07:19:50.206907 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"810a667ca22eaa95920f5c93102abaed80131a4edd86cbcaa985231bdddf0221\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998566060Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998668749Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998764689Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998764097Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998900737Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998972065Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.999080626Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:50 kc05 containerd[1478]: time="2024-09-30T07:19:50.998871559Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:50.999175161Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:50.999291281Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:50.999337655Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.007466198Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.007527469Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.007500542Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.007639366Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.008109785Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.008155059Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.008310016Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.008445121Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.008694664Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.589605282Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.589936 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.590042 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.590084 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.590155 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.645747743Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.646083 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.646180 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.646236 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.646321 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:19:51 kc05 containerd[1478]: time="2024-09-30T07:19:51.676960785Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.677363 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.677460 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.677516 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:19:51 kc05 kubelet[1593]: E0930 07:19:51.677598 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:19:52 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-db1068ab7d7067541619de47f85341cce58edbb2574eb50423cf6b4240090a27-shm.mount: Deactivated successfully. Sep 30 07:19:52 kc05 systemd[1]: run-netns-cni\x2ddc3d32a7\x2dcf67\x2da9b0\x2d4ab1\x2db179556605d6.mount: Deactivated successfully. Sep 30 07:19:52 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-f171741f46f68b2adde17989f708999096390b1f68ad5229cd7f8bd30da07dbf-shm.mount: Deactivated successfully. Sep 30 07:19:52 kc05 systemd[1]: run-netns-cni\x2de999be5d\x2dea18\x2ddfa8\x2d0f85\x2dd791569c06ec.mount: Deactivated successfully. Sep 30 07:19:52 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-2aead8164fad24ca94cc1d66cb075c65d98b9d14c184bbd105edde208d1adfa8-shm.mount: Deactivated successfully. Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.051324 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.078903 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.111573 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.111604 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.141906 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.172827 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.206338 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:19:57 kc05 kubelet[1593]: W0930 07:19:57.241327 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:00 kc05 kubelet[1593]: I0930 07:20:00.998820 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.000478082Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.617676108Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.632133249Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.640489384Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 639.930931ms" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.640544751Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:20:01 kc05 kubelet[1593]: E0930 07:20:01.641529 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:01 kc05 kubelet[1593]: E0930 07:20:01.642769 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.998658077Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:20:01 kc05 containerd[1478]: time="2024-09-30T07:20:01.998760604Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.008283295Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.008329455Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.009089022Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:20:02 kc05 systemd[1]: run-netns-cni\x2d12421d2a\x2da3a5\x2d416f\x2df1bf\x2de648c03fd1b5.mount: Deactivated successfully. Sep 30 07:20:02 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada-shm.mount: Deactivated successfully. Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.171585737Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:02 kc05 kubelet[1593]: E0930 07:20:02.171973 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:02 kc05 kubelet[1593]: E0930 07:20:02.172088 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:02 kc05 kubelet[1593]: E0930 07:20:02.172138 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:02 kc05 kubelet[1593]: E0930 07:20:02.172229 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"56924a4bdc7db21e4bbce2b6023f65b54822b33e5ca86c9824f0c23d14cfdada\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.998916505Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999040262Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999144027Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999199786Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999245762Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999165297Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:20:02 kc05 containerd[1478]: time="2024-09-30T07:20:02.999383510Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.009956655Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.010010158Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.010756684Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.021860186Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.021910387Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.022701467Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:20:03 kc05 systemd[1]: run-netns-cni\x2d8383874c\x2d68a9\x2d776c\x2d82e6\x2dcc0afb206556.mount: Deactivated successfully. Sep 30 07:20:03 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6-shm.mount: Deactivated successfully. Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.398543539Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.398945 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.399094 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.399153 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.399250 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"70a4aa5df53cc62c9869af4338feaaa36f097b515618c3889168dd3f81e85bb6\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:20:03 kc05 containerd[1478]: time="2024-09-30T07:20:03.474703550Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.475080 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.475174 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.475226 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:03 kc05 kubelet[1593]: E0930 07:20:03.475315 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:20:04 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-461ad7bd1f10d8fc2c221513a4f9d62eec3403e2cc744e2c62c39b0a84006152-shm.mount: Deactivated successfully. Sep 30 07:20:04 kc05 containerd[1478]: time="2024-09-30T07:20:04.998927442Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:20:04 kc05 containerd[1478]: time="2024-09-30T07:20:04.999073937Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:04 kc05 containerd[1478]: time="2024-09-30T07:20:04.999179326Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:04 kc05 containerd[1478]: time="2024-09-30T07:20:04.999228501Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:05 kc05 kubelet[1593]: I0930 07:20:04.999205 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.000389 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.000441 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.001626 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.001653 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:20:05 kc05 containerd[1478]: time="2024-09-30T07:20:05.007624302Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:20:05 kc05 containerd[1478]: time="2024-09-30T07:20:05.007662612Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:20:05 kc05 containerd[1478]: time="2024-09-30T07:20:05.008360423Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:20:05 kc05 systemd[1]: run-netns-cni\x2d435877f5\x2d16ef\x2d0a57\x2dd95c\x2d22ee7ab664e9.mount: Deactivated successfully. Sep 30 07:20:05 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a-shm.mount: Deactivated successfully. Sep 30 07:20:05 kc05 containerd[1478]: time="2024-09-30T07:20:05.126685369Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.127100 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.127225 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.127292 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:05 kc05 kubelet[1593]: E0930 07:20:05.127403 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"cd38fdbd5502cdd811ac4b0887ff741a97b46f0a187195e44d4b2593fa055d2a\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.033448 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.063444 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.096306 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.130612 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.169246 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.196484 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.229054 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:07 kc05 kubelet[1593]: W0930 07:20:07.229083 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:11 kc05 kubelet[1593]: I0930 07:20:11.998411 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:20:11 kc05 kubelet[1593]: E0930 07:20:11.998703 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:20:12 kc05 kubelet[1593]: W0930 07:20:12.030025 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:13 kc05 containerd[1478]: time="2024-09-30T07:20:13.998521560Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:20:13 kc05 containerd[1478]: time="2024-09-30T07:20:13.998619789Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:14 kc05 containerd[1478]: time="2024-09-30T07:20:14.007297167Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:20:14 kc05 containerd[1478]: time="2024-09-30T07:20:14.007347281Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:20:14 kc05 containerd[1478]: time="2024-09-30T07:20:14.008156518Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:20:14 kc05 systemd[1]: run-netns-cni\x2d1bf210e3\x2d9787\x2dbd2c\x2d1c81\x2d712a92ad784e.mount: Deactivated successfully. Sep 30 07:20:14 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e-shm.mount: Deactivated successfully. Sep 30 07:20:14 kc05 containerd[1478]: time="2024-09-30T07:20:14.150707930Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:14 kc05 kubelet[1593]: E0930 07:20:14.151104 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:14 kc05 kubelet[1593]: E0930 07:20:14.151193 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:14 kc05 kubelet[1593]: E0930 07:20:14.151239 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:14 kc05 kubelet[1593]: E0930 07:20:14.151315 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ed9d135116fb8d1a91f56d688e2971fe6089940c42eeccd1f7a664601f86fe4e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:20:14 kc05 containerd[1478]: time="2024-09-30T07:20:14.999269216Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:14.999380732Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.023341137Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.023389689Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.024241858Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:20:15 kc05 systemd[1]: run-netns-cni\x2db25bf008\x2d9331\x2df777\x2d784c\x2db06994e3c86a.mount: Deactivated successfully. Sep 30 07:20:15 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a-shm.mount: Deactivated successfully. Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.183919738Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:15 kc05 kubelet[1593]: E0930 07:20:15.184362 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:15 kc05 kubelet[1593]: E0930 07:20:15.184480 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:15 kc05 kubelet[1593]: E0930 07:20:15.184537 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:15 kc05 kubelet[1593]: E0930 07:20:15.184641 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e36719fca7933ea23037e487e73a1eb5c3fe17bb832c6a388be8f2ea22b9455a\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.998623633Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.998681080Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.998732342Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.998750870Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:15 kc05 containerd[1478]: time="2024-09-30T07:20:15.998769114Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:16 kc05 containerd[1478]: time="2024-09-30T07:20:16.006919304Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:20:16 kc05 containerd[1478]: time="2024-09-30T07:20:16.006972320Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:20:16 kc05 containerd[1478]: time="2024-09-30T07:20:16.007782353Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:20:16 kc05 systemd[1]: run-netns-cni\x2ded19bb9b\x2d3336\x2defa9\x2dba79\x2d8508769a9094.mount: Deactivated successfully. Sep 30 07:20:16 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4-shm.mount: Deactivated successfully. Sep 30 07:20:16 kc05 containerd[1478]: time="2024-09-30T07:20:16.131832846Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:16 kc05 kubelet[1593]: E0930 07:20:16.132259 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:16 kc05 kubelet[1593]: E0930 07:20:16.132369 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:16 kc05 kubelet[1593]: E0930 07:20:16.132422 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:16 kc05 kubelet[1593]: E0930 07:20:16.132514 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5866a554efdb78893a05da7100d732c11c7963887ce58587c2d52522427196e4\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.039383 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.070514 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.103269 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.135521 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.168294 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.196109 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.226592 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:17 kc05 kubelet[1593]: W0930 07:20:17.226618 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:17 kc05 kubelet[1593]: I0930 07:20:17.998301 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:20:17 kc05 kubelet[1593]: E0930 07:20:17.998577 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:20:17 kc05 kubelet[1593]: E0930 07:20:17.999452 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:18 kc05 kubelet[1593]: E0930 07:20:18.000699 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:20:18 kc05 kubelet[1593]: W0930 07:20:18.027988 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:18 kc05 containerd[1478]: time="2024-09-30T07:20:18.998570100Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:20:18 kc05 containerd[1478]: time="2024-09-30T07:20:18.998677145Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:18 kc05 containerd[1478]: time="2024-09-30T07:20:18.998776535Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:18 kc05 containerd[1478]: time="2024-09-30T07:20:18.998813808Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:19 kc05 containerd[1478]: time="2024-09-30T07:20:19.008484809Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:20:19 kc05 containerd[1478]: time="2024-09-30T07:20:19.008548412Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:20:19 kc05 containerd[1478]: time="2024-09-30T07:20:19.009290330Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:20:19 kc05 systemd[1]: run-netns-cni\x2d95ba9458\x2daf06\x2d6649\x2d5f74\x2db310acf94a2e.mount: Deactivated successfully. Sep 30 07:20:19 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3-shm.mount: Deactivated successfully. Sep 30 07:20:19 kc05 containerd[1478]: time="2024-09-30T07:20:19.184884498Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:19 kc05 kubelet[1593]: E0930 07:20:19.185311 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:19 kc05 kubelet[1593]: E0930 07:20:19.185433 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:19 kc05 kubelet[1593]: E0930 07:20:19.185489 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:19 kc05 kubelet[1593]: E0930 07:20:19.185583 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6482a90e89b5f22f48a2be097e3f8e14eaec8cdd063ffacc8b4be37495133ec3\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:20:27 kc05 kubelet[1593]: I0930 07:20:27.007230 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.007403 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.007561593Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.007615826Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.007857205Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.007955288Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.016575148Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.016614238Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.017399018Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.031364444Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.031409139Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.032132792Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.036977 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.069044 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.069064 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.099028 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.128782 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.158204 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.192251 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.228905 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 kubelet[1593]: W0930 07:20:27.260411 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:27 kc05 systemd[1]: run-netns-cni\x2d51192fc9\x2d44bf\x2dcefe\x2d97bb\x2da2f8958adfeb.mount: Deactivated successfully. Sep 30 07:20:27 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6-shm.mount: Deactivated successfully. Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.392832222Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.393310 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.393460 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.393514 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.393605 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3b270338e2a41a96d36bce215fb8f2025adf53e3f5ba8a15404fd450a5a377d6\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.432527037Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.432894 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.432981 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.433071 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:27 kc05 kubelet[1593]: E0930 07:20:27.433161 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.999308841Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.999405622Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.999491509Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.999528087Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:27 kc05 containerd[1478]: time="2024-09-30T07:20:27.999564581Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:28 kc05 containerd[1478]: time="2024-09-30T07:20:28.008852237Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:20:28 kc05 containerd[1478]: time="2024-09-30T07:20:28.008905066Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:20:28 kc05 containerd[1478]: time="2024-09-30T07:20:28.009549853Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:20:28 kc05 containerd[1478]: time="2024-09-30T07:20:28.209443520Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e0217f01bca8645188fbeec774534199de085ee77b884ee4a990d8b6181c80ec\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:28 kc05 kubelet[1593]: E0930 07:20:28.209821 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0217f01bca8645188fbeec774534199de085ee77b884ee4a990d8b6181c80ec\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:28 kc05 kubelet[1593]: E0930 07:20:28.209918 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0217f01bca8645188fbeec774534199de085ee77b884ee4a990d8b6181c80ec\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:28 kc05 kubelet[1593]: E0930 07:20:28.209958 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e0217f01bca8645188fbeec774534199de085ee77b884ee4a990d8b6181c80ec\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:28 kc05 kubelet[1593]: E0930 07:20:28.210057 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e0217f01bca8645188fbeec774534199de085ee77b884ee4a990d8b6181c80ec\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:20:28 kc05 systemd[1]: run-netns-cni\x2d329e6537\x2dc58b\x2d5739\x2d4bcd\x2d9845fcd2984e.mount: Deactivated successfully. Sep 30 07:20:28 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-09cb7e1a1a765bf9706abb7d5d014c8de887211cfd9f831188448259e3055a5f-shm.mount: Deactivated successfully. Sep 30 07:20:31 kc05 kubelet[1593]: I0930 07:20:31.998314 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:20:31 kc05 kubelet[1593]: E0930 07:20:31.998620 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:20:31 kc05 kubelet[1593]: E0930 07:20:31.999428 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-w2dls,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-v97wm_kube-flannel(05076276-0f40-42f8-9fde-88caea2027b7): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:32 kc05 kubelet[1593]: E0930 07:20:32.000729 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-v97wm" podUID="05076276-0f40-42f8-9fde-88caea2027b7" Sep 30 07:20:32 kc05 kubelet[1593]: W0930 07:20:32.027289 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:33 kc05 containerd[1478]: time="2024-09-30T07:20:33.998827878Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:20:33 kc05 containerd[1478]: time="2024-09-30T07:20:33.998941219Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:33 kc05 containerd[1478]: time="2024-09-30T07:20:33.999066425Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:33 kc05 containerd[1478]: time="2024-09-30T07:20:33.999115978Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:34 kc05 containerd[1478]: time="2024-09-30T07:20:34.008481101Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:20:34 kc05 containerd[1478]: time="2024-09-30T07:20:34.008528811Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:20:34 kc05 containerd[1478]: time="2024-09-30T07:20:34.009318231Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:20:34 kc05 systemd[1]: run-netns-cni\x2d037703ee\x2d6ba9\x2d8cdc\x2dc6b9\x2d1b0025d21f8f.mount: Deactivated successfully. Sep 30 07:20:34 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f-shm.mount: Deactivated successfully. Sep 30 07:20:34 kc05 kubelet[1593]: W0930 07:20:34.119043 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:20:34 kc05 kubelet[1593]: E0930 07:20:34.119109 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:20:34 kc05 containerd[1478]: time="2024-09-30T07:20:34.138540433Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:34 kc05 kubelet[1593]: E0930 07:20:34.138968 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:34 kc05 kubelet[1593]: E0930 07:20:34.139099 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:34 kc05 kubelet[1593]: E0930 07:20:34.139156 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:34 kc05 kubelet[1593]: E0930 07:20:34.139248 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2ffb2a052a79857f617edca318360153d14b2ac001edba5d407655aec484f95f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.039169 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.071272 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.110017 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.142637 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.173068 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.173100 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.214257 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:37 kc05 kubelet[1593]: W0930 07:20:37.245685 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:40 kc05 kubelet[1593]: I0930 07:20:40.998703 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:20:40 kc05 kubelet[1593]: E0930 07:20:40.998887 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:20:41 kc05 containerd[1478]: time="2024-09-30T07:20:41.999197243Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:41.999304451Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:41.999423044Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:41.999506361Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.008849951Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.008906072Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.009681454Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.022590194Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.022637529Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.023511668Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.234837967Z" level=info msg="StopPodSandbox for \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\"" Sep 30 07:20:42 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae-shm.mount: Deactivated successfully. Sep 30 07:20:42 kc05 systemd[1]: cri-containerd-c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae.scope: Deactivated successfully. Sep 30 07:20:42 kc05 systemd[1]: run-netns-cni\x2db95cf251\x2d77ef\x2d124d\x2d7ccc\x2de5686bc2d6b0.mount: Deactivated successfully. Sep 30 07:20:42 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3-shm.mount: Deactivated successfully. Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.268614 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.268659 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.462513722Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.462962 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.463105 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.463164 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.463270 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bdc1fb26b8b5b6f8d815df9b52b00b2af66dad91cacc724517db56cb6a50e5c3\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.503861802Z" level=info msg="shim disconnected" id=c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae namespace=k8s.io Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.503972259Z" level=warning msg="cleaning up after shim disconnected" id=c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae namespace=k8s.io Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.504031954Z" level=info msg="cleaning up dead shim" namespace=k8s.io Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.525288200Z" level=info msg="TearDown network for sandbox \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.525337760Z" level=info msg="StopPodSandbox for \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" returns successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.526011426Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.526093123Z" level=info msg="Container to stop \"ba1e62942dbd3e328c57b25afc68812558508a7185d230165e704a6922b29581\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.526254890Z" level=info msg="TearDown network for sandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.526281107Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" returns successfully" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.539578864Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.539883 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.539958 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.540021 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.540101 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.568513 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.568547 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673040 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-run\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673104 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-run" (OuterVolumeSpecName: "run") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673148 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-plugin\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni-plugin\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673225 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2dls\" (UniqueName: \"kubernetes.io/projected/05076276-0f40-42f8-9fde-88caea2027b7-kube-api-access-w2dls\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673274 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673265 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni-plugin" (OuterVolumeSpecName: "cni-plugin") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "cni-plugin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673323 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-xtables-lock\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673371 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni" (OuterVolumeSpecName: "cni") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "cni". PluginName "kubernetes.io/host-path", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673391 1593 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"flannel-cfg\" (UniqueName: \"kubernetes.io/configmap/05076276-0f40-42f8-9fde-88caea2027b7-flannel-cfg\") pod \"05076276-0f40-42f8-9fde-88caea2027b7\" (UID: \"05076276-0f40-42f8-9fde-88caea2027b7\") " Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673439 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-xtables-lock" (OuterVolumeSpecName: "xtables-lock") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "xtables-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673544 1593 reconciler_common.go:288] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-run\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673590 1593 reconciler_common.go:288] "Volume detached for volume \"cni-plugin\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni-plugin\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673629 1593 reconciler_common.go:288] "Volume detached for volume \"cni\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-cni\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.673667 1593 reconciler_common.go:288] "Volume detached for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/05076276-0f40-42f8-9fde-88caea2027b7-xtables-lock\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.674457 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05076276-0f40-42f8-9fde-88caea2027b7-flannel-cfg" (OuterVolumeSpecName: "flannel-cfg") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "flannel-cfg". PluginName "kubernetes.io/configmap", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.692909 1593 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05076276-0f40-42f8-9fde-88caea2027b7-kube-api-access-w2dls" (OuterVolumeSpecName: "kube-api-access-w2dls") pod "05076276-0f40-42f8-9fde-88caea2027b7" (UID: "05076276-0f40-42f8-9fde-88caea2027b7"). InnerVolumeSpecName "kube-api-access-w2dls". PluginName "kubernetes.io/projected", VolumeGidValue "" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.774988 1593 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-w2dls\" (UniqueName: \"kubernetes.io/projected/05076276-0f40-42f8-9fde-88caea2027b7-kube-api-access-w2dls\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.775074 1593 reconciler_common.go:288] "Volume detached for volume \"flannel-cfg\" (UniqueName: \"kubernetes.io/configmap/05076276-0f40-42f8-9fde-88caea2027b7-flannel-cfg\") on node \"kc05\" DevicePath \"\"" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.811959 1593 scope.go:117] "RemoveContainer" containerID="ba1e62942dbd3e328c57b25afc68812558508a7185d230165e704a6922b29581" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.813625004Z" level=info msg="RemoveContainer for \"ba1e62942dbd3e328c57b25afc68812558508a7185d230165e704a6922b29581\"" Sep 30 07:20:42 kc05 systemd[1]: Removed slice kubepods-burstable-pod05076276_0f40_42f8_9fde_88caea2027b7.slice - libcontainer container kubepods-burstable-pod05076276_0f40_42f8_9fde_88caea2027b7.slice. Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.845696273Z" level=info msg="RemoveContainer for \"ba1e62942dbd3e328c57b25afc68812558508a7185d230165e704a6922b29581\" returns successfully" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.846804 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.846832 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.882151 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.882184 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.940802 1593 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="kube-flannel" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.940845 1593 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="kube-flannel" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.940868 1593 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="install-cni-plugin" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.940892 1593 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="install-cni" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.940963 1593 memory_manager.go:354] "RemoveStaleState removing state" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="kube-flannel" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.941001 1593 memory_manager.go:354] "RemoveStaleState removing state" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="kube-flannel" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.941027 1593 memory_manager.go:354] "RemoveStaleState removing state" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="install-cni" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.941057 1593 memory_manager.go:354] "RemoveStaleState removing state" podUID="05076276-0f40-42f8-9fde-88caea2027b7" containerName="install-cni-plugin" Sep 30 07:20:42 kc05 systemd[1]: Created slice kubepods-burstable-pod0b06a017_c2c3_452e_88ba_a0422996cf87.slice - libcontainer container kubepods-burstable-pod0b06a017_c2c3_452e_88ba_a0422996cf87.slice. Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.971618 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.971647 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.971661 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: W0930 07:20:42.971675 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:20:42 kc05 kubelet[1593]: I0930 07:20:42.997880 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:20:42 kc05 kubelet[1593]: E0930 07:20:42.998191 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.998787572Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.998923342Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.999045765Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.999084834Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:42 kc05 containerd[1478]: time="2024-09-30T07:20:42.999128921Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.003082 1593 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05076276-0f40-42f8-9fde-88caea2027b7" path="/var/lib/kubelet/pods/05076276-0f40-42f8-9fde-88caea2027b7/volumes" Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.007566194Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.007614685Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.008224215Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.077815 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni\" (UniqueName: \"kubernetes.io/host-path/0b06a017-c2c3-452e-88ba-a0422996cf87-cni\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.077879 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-plugin\" (UniqueName: \"kubernetes.io/host-path/0b06a017-c2c3-452e-88ba-a0422996cf87-cni-plugin\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.078079 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b06a017-c2c3-452e-88ba-a0422996cf87-run\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.078291 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/0b06a017-c2c3-452e-88ba-a0422996cf87-xtables-lock\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.078363 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flannel-cfg\" (UniqueName: \"kubernetes.io/configmap/0b06a017-c2c3-452e-88ba-a0422996cf87-flannel-cfg\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 kubelet[1593]: I0930 07:20:43.078471 1593 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljfs\" (UniqueName: \"kubernetes.io/projected/0b06a017-c2c3-452e-88ba-a0422996cf87-kube-api-access-nljfs\") pod \"kube-flannel-ds-nvkgc\" (UID: \"0b06a017-c2c3-452e-88ba-a0422996cf87\") " pod="kube-flannel/kube-flannel-ds-nvkgc" Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.137474248Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"0fbcd6ada9922460a43ae34dc4de19118de15a48e0c3a31cd63485460fb37537\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.137823 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fbcd6ada9922460a43ae34dc4de19118de15a48e0c3a31cd63485460fb37537\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.137902 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fbcd6ada9922460a43ae34dc4de19118de15a48e0c3a31cd63485460fb37537\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.137939 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0fbcd6ada9922460a43ae34dc4de19118de15a48e0c3a31cd63485460fb37537\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.138017 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0fbcd6ada9922460a43ae34dc4de19118de15a48e0c3a31cd63485460fb37537\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:20:43 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-16dca0aef9e323824bd31d58d92ee329340b7fc30f7a8f5cd387f78fa857b4eb-shm.mount: Deactivated successfully. Sep 30 07:20:43 kc05 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae-rootfs.mount: Deactivated successfully. Sep 30 07:20:43 kc05 systemd[1]: var-lib-kubelet-pods-05076276\x2d0f40\x2d42f8\x2d9fde\x2d88caea2027b7-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dw2dls.mount: Deactivated successfully. Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.255263768Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-flannel-ds-nvkgc,Uid:0b06a017-c2c3-452e-88ba-a0422996cf87,Namespace:kube-flannel,Attempt:0,}" Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.357145736Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.357253631Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.357303581Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.357345039Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Sep 30 07:20:43 kc05 systemd[1]: Started cri-containerd-9063b2cbeb649b69527190f87b3face353fcbcbce92f396fc24ba0f3fa98976a.scope - libcontainer container 9063b2cbeb649b69527190f87b3face353fcbcbce92f396fc24ba0f3fa98976a. Sep 30 07:20:43 kc05 containerd[1478]: time="2024-09-30T07:20:43.456158646Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-flannel-ds-nvkgc,Uid:0b06a017-c2c3-452e-88ba-a0422996cf87,Namespace:kube-flannel,Attempt:0,} returns sandbox id \"9063b2cbeb649b69527190f87b3face353fcbcbce92f396fc24ba0f3fa98976a\"" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.458239 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.459394 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.818466 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:43 kc05 kubelet[1593]: E0930 07:20:43.819724 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:20:43 kc05 kubelet[1593]: W0930 07:20:43.850934 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:20:43 kc05 kubelet[1593]: W0930 07:20:43.850980 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:43 kc05 kubelet[1593]: W0930 07:20:43.851021 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:43 kc05 kubelet[1593]: W0930 07:20:43.851039 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.037088 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.068772 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.068799 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.068813 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.068826 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.099449 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.129025 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.159923 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.192306 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 kubelet[1593]: W0930 07:20:47.221513 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:47 kc05 containerd[1478]: time="2024-09-30T07:20:47.998948634Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:20:47 kc05 containerd[1478]: time="2024-09-30T07:20:47.999091491Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:47 kc05 containerd[1478]: time="2024-09-30T07:20:47.999199951Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:47 kc05 containerd[1478]: time="2024-09-30T07:20:47.999247837Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:48 kc05 containerd[1478]: time="2024-09-30T07:20:48.008754721Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:20:48 kc05 containerd[1478]: time="2024-09-30T07:20:48.008814763Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:20:48 kc05 containerd[1478]: time="2024-09-30T07:20:48.009520731Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:20:48 kc05 systemd[1]: run-netns-cni\x2d41d88ca6\x2db1cf\x2d3800\x2d1073\x2d43c6adc9c407.mount: Deactivated successfully. Sep 30 07:20:48 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb-shm.mount: Deactivated successfully. Sep 30 07:20:48 kc05 containerd[1478]: time="2024-09-30T07:20:48.170603862Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:48 kc05 kubelet[1593]: E0930 07:20:48.171029 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:48 kc05 kubelet[1593]: E0930 07:20:48.171148 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:48 kc05 kubelet[1593]: E0930 07:20:48.171201 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:20:48 kc05 kubelet[1593]: E0930 07:20:48.171337 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b156f617be92b32db49c3160bcf4d075d0f8a5ed7c2215f09ae7ef219417e7bb\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:20:53 kc05 kubelet[1593]: I0930 07:20:53.998030 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:20:53 kc05 kubelet[1593]: E0930 07:20:53.998346 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:20:54 kc05 containerd[1478]: time="2024-09-30T07:20:54.999363755Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:54.999475581Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:54.999576307Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:54.999615842Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:54.999656734Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.009265336Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.009323502Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.010066595Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:20:55 kc05 systemd[1]: run-netns-cni\x2d24ddde42\x2d8ed8\x2d31d9\x2d3e94\x2dc14523a53c6a.mount: Deactivated successfully. Sep 30 07:20:55 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b-shm.mount: Deactivated successfully. Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.237137497Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:55 kc05 kubelet[1593]: E0930 07:20:55.237567 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:55 kc05 kubelet[1593]: E0930 07:20:55.237684 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:55 kc05 kubelet[1593]: E0930 07:20:55.237738 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:20:55 kc05 kubelet[1593]: E0930 07:20:55.237833 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"00fe38528d3c961b143bbdddd6c76480b3eaab41339bfd163bb5a07fe830651b\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.999264878Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:20:55 kc05 containerd[1478]: time="2024-09-30T07:20:55.999380980Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:55.999547846Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:55.999664974Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.000724 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.002055 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.008844057Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.008903900Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.009684437Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.022084413Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.022129911Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.022892236Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:20:56 kc05 systemd[1]: run-netns-cni\x2dd1e414b2\x2d4150\x2d8da2\x2dc1c8\x2d44930cf20656.mount: Deactivated successfully. Sep 30 07:20:56 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027-shm.mount: Deactivated successfully. Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.402587778Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.403113 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.403270 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.403345 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.403458 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"63ec553a2cbd00a59f34c5825ad1013ae9ddf369a22d45ed53c12030b2dc2027\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:20:56 kc05 containerd[1478]: time="2024-09-30T07:20:56.477671920Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.478075 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.478179 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.478236 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:20:56 kc05 kubelet[1593]: E0930 07:20:56.478326 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:20:57 kc05 kubelet[1593]: I0930 07:20:57.005602 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:20:57 kc05 kubelet[1593]: E0930 07:20:57.005865 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.033096 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.063399 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.096677 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.132364 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.161156 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-be28b47af955c15eaaf2377da54453034ab88182cdc04e2760425f47a417fe4b-shm.mount: Deactivated successfully. Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.192403 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.192434 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.192448 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.192462 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:20:57 kc05 kubelet[1593]: W0930 07:20:57.223271 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:02 kc05 containerd[1478]: time="2024-09-30T07:21:02.999224419Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:02.999335654Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:02.999435826Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:02.999502569Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:03.008459464Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:03.008507022Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:03.009266115Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:21:03 kc05 systemd[1]: run-netns-cni\x2dbb16e2fe\x2df0eb\x2d31f0\x2d45c6\x2dd3f580777eed.mount: Deactivated successfully. Sep 30 07:21:03 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07-shm.mount: Deactivated successfully. Sep 30 07:21:03 kc05 containerd[1478]: time="2024-09-30T07:21:03.173305394Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:03 kc05 kubelet[1593]: E0930 07:21:03.173759 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:03 kc05 kubelet[1593]: E0930 07:21:03.173875 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:03 kc05 kubelet[1593]: E0930 07:21:03.173928 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:03 kc05 kubelet[1593]: E0930 07:21:03.174041 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d5acb5b77f67dc71958312e77bc1afaa0a47a7e1d15b806347afe0e6c1dc8c07\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:21:07 kc05 kubelet[1593]: E0930 07:21:07.006400 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:07 kc05 kubelet[1593]: E0930 07:21:07.007610 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.034591 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.063417 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.092051 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.122752 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.155484 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.189296 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.218098 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.218130 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.218144 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:07 kc05 kubelet[1593]: W0930 07:21:07.218159 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:07 kc05 kubelet[1593]: I0930 07:21:07.998096 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:21:07 kc05 containerd[1478]: time="2024-09-30T07:21:07.998244228Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:21:07 kc05 containerd[1478]: time="2024-09-30T07:21:07.998302406Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:07 kc05 kubelet[1593]: E0930 07:21:07.998415 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.023918720Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.023976363Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.024798989Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:21:08 kc05 systemd[1]: run-netns-cni\x2de130e1e7\x2dc6c7\x2d53f5\x2d953d\x2def7fd2bb2ffe.mount: Deactivated successfully. Sep 30 07:21:08 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc-shm.mount: Deactivated successfully. Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.171128137Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:08 kc05 kubelet[1593]: E0930 07:21:08.171523 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:08 kc05 kubelet[1593]: E0930 07:21:08.171635 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:08 kc05 kubelet[1593]: E0930 07:21:08.171688 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:08 kc05 kubelet[1593]: E0930 07:21:08.171781 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8e62b43bc4a982136fb3f813e70640ae237ae7fdefde992102c121113db81ccc\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.998845089Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.998955918Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.999058520Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.999105173Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:08 kc05 containerd[1478]: time="2024-09-30T07:21:08.999141834Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:09 kc05 containerd[1478]: time="2024-09-30T07:21:09.008293977Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:21:09 kc05 containerd[1478]: time="2024-09-30T07:21:09.008341985Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:21:09 kc05 containerd[1478]: time="2024-09-30T07:21:09.009122430Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:21:09 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c-shm.mount: Deactivated successfully. Sep 30 07:21:09 kc05 containerd[1478]: time="2024-09-30T07:21:09.133513404Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:09 kc05 kubelet[1593]: E0930 07:21:09.133855 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:09 kc05 kubelet[1593]: E0930 07:21:09.133940 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:09 kc05 kubelet[1593]: E0930 07:21:09.133987 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:09 kc05 kubelet[1593]: E0930 07:21:09.134095 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8d6e4484a4b8ba2cc0361e6479aa95720adb0886820b04f42e7b3d551992263c\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:21:09 kc05 kubelet[1593]: I0930 07:21:09.998648 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:21:09 kc05 kubelet[1593]: E0930 07:21:09.998932 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:21:11 kc05 kubelet[1593]: W0930 07:21:11.702613 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:21:11 kc05 kubelet[1593]: E0930 07:21:11.702685 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:21:11 kc05 containerd[1478]: time="2024-09-30T07:21:11.998966068Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:21:11 kc05 containerd[1478]: time="2024-09-30T07:21:11.999107229Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:12 kc05 containerd[1478]: time="2024-09-30T07:21:12.008539327Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:21:12 kc05 containerd[1478]: time="2024-09-30T07:21:12.008588583Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:21:12 kc05 containerd[1478]: time="2024-09-30T07:21:12.009433008Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:21:12 kc05 systemd[1]: run-netns-cni\x2d4023fcc9\x2d1e69\x2d77b7\x2d4ffa\x2d437bbe4a7cf9.mount: Deactivated successfully. Sep 30 07:21:12 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265-shm.mount: Deactivated successfully. Sep 30 07:21:12 kc05 containerd[1478]: time="2024-09-30T07:21:12.139665114Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:12 kc05 kubelet[1593]: E0930 07:21:12.140123 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:12 kc05 kubelet[1593]: E0930 07:21:12.140235 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:12 kc05 kubelet[1593]: E0930 07:21:12.140288 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:12 kc05 kubelet[1593]: E0930 07:21:12.140386 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9f61c7288fe32cf7dccf45b51027f3b405e76b390ad08eb2457f58cec3a7b265\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:21:13 kc05 containerd[1478]: time="2024-09-30T07:21:13.998509674Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:13 kc05 containerd[1478]: time="2024-09-30T07:21:13.998629127Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:13 kc05 containerd[1478]: time="2024-09-30T07:21:13.998728552Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:13 kc05 containerd[1478]: time="2024-09-30T07:21:13.998764295Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:14 kc05 containerd[1478]: time="2024-09-30T07:21:14.008139971Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:21:14 kc05 containerd[1478]: time="2024-09-30T07:21:14.008188581Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:21:14 kc05 containerd[1478]: time="2024-09-30T07:21:14.008835472Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:21:14 kc05 systemd[1]: run-netns-cni\x2d57bf6669\x2d229f\x2d9f2a\x2d9fb8\x2d1fb29034c9c2.mount: Deactivated successfully. Sep 30 07:21:14 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2-shm.mount: Deactivated successfully. Sep 30 07:21:14 kc05 containerd[1478]: time="2024-09-30T07:21:14.166942244Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:14 kc05 kubelet[1593]: E0930 07:21:14.167396 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:14 kc05 kubelet[1593]: E0930 07:21:14.167520 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:14 kc05 kubelet[1593]: E0930 07:21:14.167575 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:14 kc05 kubelet[1593]: E0930 07:21:14.167672 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8cc1bad7061ca81c959bc6aacf4c8a4d26a2185d4fe632093052f53a5beca9b2\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.033552 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.063112 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.093311 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.126865 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.162930 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.197094 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.229153 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.229180 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.229194 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:17 kc05 kubelet[1593]: W0930 07:21:17.229207 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:21 kc05 kubelet[1593]: E0930 07:21:21.999554 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:22 kc05 kubelet[1593]: E0930 07:21:22.000884 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:21:22 kc05 kubelet[1593]: I0930 07:21:22.999058 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:21:22 kc05 containerd[1478]: time="2024-09-30T07:21:22.999205436Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:22.999319945Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:22.999949172Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.000087039Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.000195230Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.000241582Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.000289963Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.000802636Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.008881898Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.008924533Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.009625359Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.021470720Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.021520043Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.022297130Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:21:23 kc05 systemd[1]: run-netns-cni\x2d72abdfff\x2d716c\x2dfc93\x2d87ca\x2d950dace602f2.mount: Deactivated successfully. Sep 30 07:21:23 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969-shm.mount: Deactivated successfully. Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.385393750Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.385772 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.385889 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.385947 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.386061 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2a511f0d3b505808d564225a1a1f3c47e41fcd1d48ef550fb6eb126cf3493969\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.474763631Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.475211 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.475318 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.475371 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.475479 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.727195662Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.733201542Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.739285147Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 738.414419ms" Sep 30 07:21:23 kc05 containerd[1478]: time="2024-09-30T07:21:23.739345182Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.740699 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:23 kc05 kubelet[1593]: E0930 07:21:23.742053 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:21:24 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-61f9b69dec512659ab80ba2d1212c73f7a4e09344840d156827eb24a027ef4d1-shm.mount: Deactivated successfully. Sep 30 07:21:24 kc05 kubelet[1593]: I0930 07:21:24.998452 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:21:24 kc05 containerd[1478]: time="2024-09-30T07:21:24.998501064Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:21:24 kc05 containerd[1478]: time="2024-09-30T07:21:24.998618723Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:24.999752 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:25.001047 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:21:25 kc05 containerd[1478]: time="2024-09-30T07:21:25.008220236Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:21:25 kc05 containerd[1478]: time="2024-09-30T07:21:25.008268103Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:21:25 kc05 containerd[1478]: time="2024-09-30T07:21:25.008922683Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:21:25 kc05 systemd[1]: run-netns-cni\x2d17205a32\x2d1aa7\x2df1bd\x2d8bc8\x2dd5163f0259b1.mount: Deactivated successfully. Sep 30 07:21:25 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75-shm.mount: Deactivated successfully. Sep 30 07:21:25 kc05 containerd[1478]: time="2024-09-30T07:21:25.161446479Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:25.161849 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:25.161954 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:25.162026 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:25 kc05 kubelet[1593]: E0930 07:21:25.162118 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"99fd405b55d9eb3ac6c72235d6819c20f5b33e2b5a9395221be7a974f4cced75\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.008709519Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.008794504Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.008864327Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.008892630Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.017253067Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.017300538Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.018259352Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.050680 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.079019 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.108007 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.108026 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.108035 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.108044 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:27 kc05 systemd[1]: run-netns-cni\x2dc6ef1c9a\x2d49e2\x2dbc7b\x2d8f94\x2de35a2619960d.mount: Deactivated successfully. Sep 30 07:21:27 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343-shm.mount: Deactivated successfully. Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.135382 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 containerd[1478]: time="2024-09-30T07:21:27.161313745Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:27 kc05 kubelet[1593]: E0930 07:21:27.161751 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:27 kc05 kubelet[1593]: E0930 07:21:27.161854 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:27 kc05 kubelet[1593]: E0930 07:21:27.161908 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:27 kc05 kubelet[1593]: E0930 07:21:27.162016 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b1fbca2e0ce9f6133a1b1040a136098b154e9bbf253b505ec5b8f515e47b3343\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.168980 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.199150 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:27 kc05 kubelet[1593]: W0930 07:21:27.233104 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:33 kc05 containerd[1478]: time="2024-09-30T07:21:33.998289533Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:21:33 kc05 containerd[1478]: time="2024-09-30T07:21:33.998372876Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:34 kc05 containerd[1478]: time="2024-09-30T07:21:34.023354652Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:21:34 kc05 containerd[1478]: time="2024-09-30T07:21:34.023408791Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:21:34 kc05 containerd[1478]: time="2024-09-30T07:21:34.024348184Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:21:34 kc05 systemd[1]: run-netns-cni\x2d59c0a561\x2da2d8\x2dd5a6\x2db4c4\x2dfd261d7ee4fd.mount: Deactivated successfully. Sep 30 07:21:34 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0-shm.mount: Deactivated successfully. Sep 30 07:21:34 kc05 containerd[1478]: time="2024-09-30T07:21:34.245460597Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.245842 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.245948 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.246026 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.246127 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1b8cedd3ba3bb31a74f29d4efadd43f7ee00cd49deba570938a694667484eca0\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:21:34 kc05 kubelet[1593]: I0930 07:21:34.998670 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.998880 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:21:34 kc05 kubelet[1593]: E0930 07:21:34.999548 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:35 kc05 kubelet[1593]: E0930 07:21:35.000756 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:21:35 kc05 kubelet[1593]: W0930 07:21:35.029435 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:35 kc05 containerd[1478]: time="2024-09-30T07:21:35.998955675Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:21:35 kc05 containerd[1478]: time="2024-09-30T07:21:35.999084428Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:35 kc05 containerd[1478]: time="2024-09-30T07:21:35.999183570Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:35 kc05 containerd[1478]: time="2024-09-30T07:21:35.999230828Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:35 kc05 containerd[1478]: time="2024-09-30T07:21:35.999279190Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:36 kc05 containerd[1478]: time="2024-09-30T07:21:36.008179599Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:21:36 kc05 containerd[1478]: time="2024-09-30T07:21:36.008244427Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:21:36 kc05 containerd[1478]: time="2024-09-30T07:21:36.009104934Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:21:36 kc05 systemd[1]: run-netns-cni\x2dc5ea32b0\x2d3688\x2d777c\x2d8ddd\x2dd80d717a4b04.mount: Deactivated successfully. Sep 30 07:21:36 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f-shm.mount: Deactivated successfully. Sep 30 07:21:36 kc05 containerd[1478]: time="2024-09-30T07:21:36.124522205Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:36 kc05 kubelet[1593]: E0930 07:21:36.124953 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:36 kc05 kubelet[1593]: E0930 07:21:36.125107 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:36 kc05 kubelet[1593]: E0930 07:21:36.125172 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:36 kc05 kubelet[1593]: E0930 07:21:36.125288 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e899cd871e04bdb3fd73b5e74cf9d721eab0f968695dba481c062dcbb6e2c81f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.004899223Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.004951412Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.013305164Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.013379245Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.014148001Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.035970 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.070802 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.106298 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 systemd[1]: run-netns-cni\x2dde3604dc\x2d84a2\x2d4269\x2d2ced\x2de1f5c30e2f17.mount: Deactivated successfully. Sep 30 07:21:37 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8-shm.mount: Deactivated successfully. Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.137211 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.141134256Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:37 kc05 kubelet[1593]: E0930 07:21:37.141505 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:37 kc05 kubelet[1593]: E0930 07:21:37.141603 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:37 kc05 kubelet[1593]: E0930 07:21:37.141656 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:37 kc05 kubelet[1593]: E0930 07:21:37.141749 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3d2bf3f1e1f346e8333f8988712f9824abe0821bb37d31863ebc8ade7b46fcb8\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.167520 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.167553 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.167567 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.167580 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.199539 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 kubelet[1593]: W0930 07:21:37.227440 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.997949181Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.998018285Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.998062139Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:37 kc05 containerd[1478]: time="2024-09-30T07:21:37.998077152Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:38 kc05 containerd[1478]: time="2024-09-30T07:21:38.004357158Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:21:38 kc05 containerd[1478]: time="2024-09-30T07:21:38.004414131Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:21:38 kc05 containerd[1478]: time="2024-09-30T07:21:38.005232846Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:21:38 kc05 systemd[1]: run-netns-cni\x2d69846685\x2d11dc\x2deb10\x2d1360\x2d0e905604455b.mount: Deactivated successfully. Sep 30 07:21:38 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb-shm.mount: Deactivated successfully. Sep 30 07:21:38 kc05 containerd[1478]: time="2024-09-30T07:21:38.132777193Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:38 kc05 kubelet[1593]: E0930 07:21:38.133222 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:38 kc05 kubelet[1593]: E0930 07:21:38.133319 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:38 kc05 kubelet[1593]: E0930 07:21:38.133361 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:38 kc05 kubelet[1593]: E0930 07:21:38.133435 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6fe5d6401a691eb227d1e76f60a10f56d527110a3d1fb328510eb50f54e3d1cb\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:21:38 kc05 kubelet[1593]: I0930 07:21:38.998165 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:21:38 kc05 kubelet[1593]: E0930 07:21:38.998448 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:21:39 kc05 kubelet[1593]: W0930 07:21:39.027602 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.793557814Z" level=info msg="StopPodSandbox for \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.793764686Z" level=info msg="TearDown network for sandbox \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.793801003Z" level=info msg="StopPodSandbox for \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" returns successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.794277431Z" level=info msg="RemovePodSandbox for \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.794348155Z" level=info msg="Forcibly stopping sandbox \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.794498345Z" level=info msg="TearDown network for sandbox \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.822411198Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.822547343Z" level=info msg="RemovePodSandbox \"c26e200e193909a2787973e7616348aabbdfc055174a7c5ab38b557f8d838cae\" returns successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823108012Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823263934Z" level=info msg="TearDown network for sandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823293782Z" level=info msg="StopPodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" returns successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823724371Z" level=info msg="RemovePodSandbox for \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823776461Z" level=info msg="Forcibly stopping sandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\"" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.823905471Z" level=info msg="TearDown network for sandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" successfully" Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.868187897Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Sep 30 07:21:40 kc05 containerd[1478]: time="2024-09-30T07:21:40.868314159Z" level=info msg="RemovePodSandbox \"2d0d29d845899c76d8eabc256d6b1ae8bfc6eded68b230c35e1ee0352edca93f\" returns successfully" Sep 30 07:21:45 kc05 kubelet[1593]: I0930 07:21:45.998909 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:21:45 kc05 kubelet[1593]: E0930 07:21:45.999227 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:45.999193448Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:45.999341508Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:46.024609130Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:46.024680982Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:46.025509261Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:21:46 kc05 kubelet[1593]: W0930 07:21:46.029518 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:46 kc05 systemd[1]: run-netns-cni\x2deed0a295\x2dcb2d\x2da926\x2d544e\x2d713a2efbca32.mount: Deactivated successfully. Sep 30 07:21:46 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3-shm.mount: Deactivated successfully. Sep 30 07:21:46 kc05 containerd[1478]: time="2024-09-30T07:21:46.192989013Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:46 kc05 kubelet[1593]: E0930 07:21:46.193434 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:46 kc05 kubelet[1593]: E0930 07:21:46.193548 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:46 kc05 kubelet[1593]: E0930 07:21:46.193604 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:46 kc05 kubelet[1593]: E0930 07:21:46.193701 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6ecf2494d1ec23e15d8237e42ba4ddbfeab08460593e20a92605a644706713d3\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.042938 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.077626 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.106774 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.137812 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.137842 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.137856 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.137869 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.171358 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.201012 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 kubelet[1593]: W0930 07:21:47.232100 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:47 kc05 containerd[1478]: time="2024-09-30T07:21:47.999217378Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999320818Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999483207Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999586241Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999681394Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999717235Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:47.999755147Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.007636508Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.007695882Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.008527626Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.010105242Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.010156860Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.010690032Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:21:48 kc05 systemd[1]: run-netns-cni\x2db710ce3f\x2d34c0\x2d63da\x2dc959\x2d1bed3192f38b.mount: Deactivated successfully. Sep 30 07:21:48 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070-shm.mount: Deactivated successfully. Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.304719973Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.305178 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.305293 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.305360 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.305465 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bc780c64d5f51551e6497bbed4db7c4e95c783984a55ed6694e3791cd5180070\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.385857365Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.386332 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.386439 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.386494 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:21:48 kc05 kubelet[1593]: E0930 07:21:48.386586 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.998887324Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.998966817Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.999049154Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:48 kc05 containerd[1478]: time="2024-09-30T07:21:48.999078668Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.000347 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.001600 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:21:49 kc05 containerd[1478]: time="2024-09-30T07:21:49.007472720Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:21:49 kc05 containerd[1478]: time="2024-09-30T07:21:49.007514524Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:21:49 kc05 containerd[1478]: time="2024-09-30T07:21:49.008170007Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:21:49 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-1688eebad6fc38f7cb430f6bcee0be5dffcb713f176dbd7f97be0bea84ac39b9-shm.mount: Deactivated successfully. Sep 30 07:21:49 kc05 containerd[1478]: time="2024-09-30T07:21:49.184613896Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"14c8f9bc9803ec9464309028e2ce5c21b9084e581ea844e8800d165ac02b6d61\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.185047 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"14c8f9bc9803ec9464309028e2ce5c21b9084e581ea844e8800d165ac02b6d61\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.185171 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"14c8f9bc9803ec9464309028e2ce5c21b9084e581ea844e8800d165ac02b6d61\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.185223 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"14c8f9bc9803ec9464309028e2ce5c21b9084e581ea844e8800d165ac02b6d61\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.185323 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"14c8f9bc9803ec9464309028e2ce5c21b9084e581ea844e8800d165ac02b6d61\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:21:49 kc05 kubelet[1593]: I0930 07:21:49.998377 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:21:49 kc05 kubelet[1593]: E0930 07:21:49.998698 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:21:50 kc05 kubelet[1593]: W0930 07:21:50.029801 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.006512690Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.006587288Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.031106519Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.031150628Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.031974573Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.042893 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.079272 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.108195 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.138160 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.138186 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.138194 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.138203 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:21:57 kc05 systemd[1]: run-netns-cni\x2d0a436bb6\x2d924e\x2d5da8\x2d31f1\x2d5fb1c515f923.mount: Deactivated successfully. Sep 30 07:21:57 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c-shm.mount: Deactivated successfully. Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.169138 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 containerd[1478]: time="2024-09-30T07:21:57.180393471Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:57 kc05 kubelet[1593]: E0930 07:21:57.180796 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:21:57 kc05 kubelet[1593]: E0930 07:21:57.180895 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:57 kc05 kubelet[1593]: E0930 07:21:57.180947 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:21:57 kc05 kubelet[1593]: E0930 07:21:57.181061 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ed1a0ff4728872e2391e588ac1ffbd47420e2773b7a7f22835cb42d32217687c\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.199776 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:57 kc05 kubelet[1593]: W0930 07:21:57.228547 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:21:58 kc05 kubelet[1593]: W0930 07:21:58.128238 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:21:58 kc05 kubelet[1593]: E0930 07:21:58.128302 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:21:59 kc05 kubelet[1593]: I0930 07:21:59.998791 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:21:59 kc05 kubelet[1593]: E0930 07:21:59.999147 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:21:59 kc05 containerd[1478]: time="2024-09-30T07:21:59.999013448Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:21:59 kc05 containerd[1478]: time="2024-09-30T07:21:59.999126505Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:59 kc05 containerd[1478]: time="2024-09-30T07:21:59.999230064Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:21:59 kc05 containerd[1478]: time="2024-09-30T07:21:59.999279211Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.007934330Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.007984036Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.008605666Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:22:00 kc05 systemd[1]: run-netns-cni\x2db38485c7\x2d52cf\x2d0e62\x2d6101\x2d881ce3b00540.mount: Deactivated successfully. Sep 30 07:22:00 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e-shm.mount: Deactivated successfully. Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.134503393Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:00 kc05 kubelet[1593]: E0930 07:22:00.134920 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:00 kc05 kubelet[1593]: E0930 07:22:00.135058 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:00 kc05 kubelet[1593]: E0930 07:22:00.135113 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:00 kc05 kubelet[1593]: E0930 07:22:00.135216 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"774ef9ceb5f89137d6d35bfa615acde72f821b53a86819023fef8de4b923518e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.999081542Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:22:00 kc05 containerd[1478]: time="2024-09-30T07:22:00.999182103Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.000086 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.001308 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:22:01 kc05 containerd[1478]: time="2024-09-30T07:22:01.009310323Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:22:01 kc05 containerd[1478]: time="2024-09-30T07:22:01.009361478Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:22:01 kc05 containerd[1478]: time="2024-09-30T07:22:01.010018805Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:22:01 kc05 systemd[1]: run-netns-cni\x2d2dd5ef92\x2dcb3e\x2df0aa\x2da2dc\x2d6bf21b56a6cb.mount: Deactivated successfully. Sep 30 07:22:01 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff-shm.mount: Deactivated successfully. Sep 30 07:22:01 kc05 containerd[1478]: time="2024-09-30T07:22:01.160461089Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.160812 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.160901 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.160947 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:01 kc05 kubelet[1593]: E0930 07:22:01.161044 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0b9cb76e79be3c3a2b370008418cc6fb83067eb3ea4eea6ccf02e22e799386ff\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:22:02 kc05 containerd[1478]: time="2024-09-30T07:22:02.998721488Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:22:02 kc05 containerd[1478]: time="2024-09-30T07:22:02.998823337Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:02 kc05 containerd[1478]: time="2024-09-30T07:22:02.998925167Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:02 kc05 containerd[1478]: time="2024-09-30T07:22:02.998972887Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:02 kc05 containerd[1478]: time="2024-09-30T07:22:02.999040084Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:03 kc05 containerd[1478]: time="2024-09-30T07:22:03.008187316Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:22:03 kc05 containerd[1478]: time="2024-09-30T07:22:03.008241051Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:22:03 kc05 containerd[1478]: time="2024-09-30T07:22:03.008983403Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:22:03 kc05 systemd[1]: run-netns-cni\x2d9f01e5e7\x2d1995\x2d4a89\x2de39a\x2dbf21949e0310.mount: Deactivated successfully. Sep 30 07:22:03 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf-shm.mount: Deactivated successfully. Sep 30 07:22:03 kc05 containerd[1478]: time="2024-09-30T07:22:03.158400970Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:03 kc05 kubelet[1593]: E0930 07:22:03.158789 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:03 kc05 kubelet[1593]: E0930 07:22:03.158893 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:03 kc05 kubelet[1593]: E0930 07:22:03.158950 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:03 kc05 kubelet[1593]: E0930 07:22:03.159064 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e8daed89c88cf095a0a394e30fb8188835094c10e2df3554c06f20d669bb55bf\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:22:04 kc05 kubelet[1593]: I0930 07:22:04.998785 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:22:04 kc05 kubelet[1593]: E0930 07:22:04.999098 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.035164 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.067139 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.100785 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.127480 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.157320 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.157353 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.157371 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.157388 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.184548 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:07 kc05 kubelet[1593]: W0930 07:22:07.213591 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:08 kc05 containerd[1478]: time="2024-09-30T07:22:08.998580428Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:22:08 kc05 containerd[1478]: time="2024-09-30T07:22:08.998693916Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:09 kc05 containerd[1478]: time="2024-09-30T07:22:09.021392892Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:22:09 kc05 containerd[1478]: time="2024-09-30T07:22:09.021457138Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:22:09 kc05 containerd[1478]: time="2024-09-30T07:22:09.022278673Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:22:09 kc05 systemd[1]: run-netns-cni\x2deb9cfdb4\x2d0719\x2dbebc\x2d4012\x2d22a853b21cf9.mount: Deactivated successfully. Sep 30 07:22:09 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c-shm.mount: Deactivated successfully. Sep 30 07:22:09 kc05 containerd[1478]: time="2024-09-30T07:22:09.210213019Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:09 kc05 kubelet[1593]: E0930 07:22:09.210578 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:09 kc05 kubelet[1593]: E0930 07:22:09.210676 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:09 kc05 kubelet[1593]: E0930 07:22:09.210726 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:09 kc05 kubelet[1593]: E0930 07:22:09.210819 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a09e76f6399d7bf6937f1c606ca0c5c473c2dd5858035c835ff31a3fbc36802c\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:22:10 kc05 kubelet[1593]: I0930 07:22:10.998814 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:22:10 kc05 kubelet[1593]: E0930 07:22:10.999135 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:22:11 kc05 containerd[1478]: time="2024-09-30T07:22:11.998488515Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:22:11 kc05 containerd[1478]: time="2024-09-30T07:22:11.998584229Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:12 kc05 containerd[1478]: time="2024-09-30T07:22:12.008754239Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:22:12 kc05 containerd[1478]: time="2024-09-30T07:22:12.008815981Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:22:12 kc05 containerd[1478]: time="2024-09-30T07:22:12.009762099Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:22:12 kc05 systemd[1]: run-netns-cni\x2d45729523\x2dc64b\x2d44e1\x2d2e9a\x2ddd5f812ed3e7.mount: Deactivated successfully. Sep 30 07:22:12 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9-shm.mount: Deactivated successfully. Sep 30 07:22:12 kc05 containerd[1478]: time="2024-09-30T07:22:12.151938995Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:12 kc05 kubelet[1593]: E0930 07:22:12.152375 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:12 kc05 kubelet[1593]: E0930 07:22:12.152496 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:12 kc05 kubelet[1593]: E0930 07:22:12.152568 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:12 kc05 kubelet[1593]: E0930 07:22:12.152688 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0e58519ddca3034df3f960206920fef363017619d6b4123f7d12c9a517b443a9\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:22:14 kc05 containerd[1478]: time="2024-09-30T07:22:14.998665178Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:22:14 kc05 containerd[1478]: time="2024-09-30T07:22:14.998788607Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:14 kc05 containerd[1478]: time="2024-09-30T07:22:14.998897991Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:14 kc05 containerd[1478]: time="2024-09-30T07:22:14.998946129Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.000053 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.001283 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:22:15 kc05 containerd[1478]: time="2024-09-30T07:22:15.008233795Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:22:15 kc05 containerd[1478]: time="2024-09-30T07:22:15.008284368Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:22:15 kc05 containerd[1478]: time="2024-09-30T07:22:15.008813495Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:22:15 kc05 systemd[1]: run-netns-cni\x2d22c16fa3\x2d890f\x2da44d\x2d50af\x2d9da979def3f8.mount: Deactivated successfully. Sep 30 07:22:15 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab-shm.mount: Deactivated successfully. Sep 30 07:22:15 kc05 containerd[1478]: time="2024-09-30T07:22:15.168450476Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.168822 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.168906 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.168942 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.169015 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fa4b41b1159bfb55b30eae13ee651bf9987d3895a1fd6b5926504851da8e03ab\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:22:15 kc05 kubelet[1593]: I0930 07:22:15.998632 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:22:15 kc05 kubelet[1593]: E0930 07:22:15.998962 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:22:15 kc05 containerd[1478]: time="2024-09-30T07:22:15.999387066Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:15.999519002Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:15.999621685Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:15.999670744Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:15.999711656Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:16.009275685Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:16.009322506Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:16.010089074Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:22:16 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0-shm.mount: Deactivated successfully. Sep 30 07:22:16 kc05 containerd[1478]: time="2024-09-30T07:22:16.129875199Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:16 kc05 kubelet[1593]: E0930 07:22:16.130270 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:16 kc05 kubelet[1593]: E0930 07:22:16.130385 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:16 kc05 kubelet[1593]: E0930 07:22:16.130441 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:16 kc05 kubelet[1593]: E0930 07:22:16.130531 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"03d13269b7fd483ab0f5fc3634a36f8bdd50edee66b74099c8f19f87b1550db0\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.035057 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.067456 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.102835 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.131610 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.161125 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.161154 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.161169 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.161183 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.190504 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:17 kc05 kubelet[1593]: W0930 07:22:17.218967 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:19 kc05 containerd[1478]: time="2024-09-30T07:22:19.998215523Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:22:19 kc05 containerd[1478]: time="2024-09-30T07:22:19.998306206Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:20 kc05 containerd[1478]: time="2024-09-30T07:22:20.020400796Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:22:20 kc05 containerd[1478]: time="2024-09-30T07:22:20.020449092Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:22:20 kc05 containerd[1478]: time="2024-09-30T07:22:20.021203310Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:22:20 kc05 systemd[1]: run-netns-cni\x2d9cda4b16\x2d516e\x2d50b6\x2db88f\x2d18ff40f37a6f.mount: Deactivated successfully. Sep 30 07:22:20 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70-shm.mount: Deactivated successfully. Sep 30 07:22:20 kc05 containerd[1478]: time="2024-09-30T07:22:20.198544075Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:20 kc05 kubelet[1593]: E0930 07:22:20.199023 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:20 kc05 kubelet[1593]: E0930 07:22:20.199147 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:20 kc05 kubelet[1593]: E0930 07:22:20.199204 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:20 kc05 kubelet[1593]: E0930 07:22:20.199306 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eb3eddde552528f420f6d06d3649b5f442fdc33aed0ac6c76024d7ee282e8f70\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:22:21 kc05 kubelet[1593]: I0930 07:22:21.997847 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:22:21 kc05 kubelet[1593]: E0930 07:22:21.998174 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:22:22 kc05 containerd[1478]: time="2024-09-30T07:22:22.999234519Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:22:23 kc05 containerd[1478]: time="2024-09-30T07:22:22.999333190Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:23 kc05 containerd[1478]: time="2024-09-30T07:22:23.008174972Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:22:23 kc05 containerd[1478]: time="2024-09-30T07:22:23.008226496Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:22:23 kc05 containerd[1478]: time="2024-09-30T07:22:23.008901557Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:22:23 kc05 systemd[1]: run-netns-cni\x2dcf773809\x2d7640\x2d6713\x2d3900\x2d0f4889eb03fb.mount: Deactivated successfully. Sep 30 07:22:23 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b-shm.mount: Deactivated successfully. Sep 30 07:22:23 kc05 containerd[1478]: time="2024-09-30T07:22:23.176556364Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:23 kc05 kubelet[1593]: E0930 07:22:23.176931 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:23 kc05 kubelet[1593]: E0930 07:22:23.177044 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:23 kc05 kubelet[1593]: E0930 07:22:23.177085 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:23 kc05 kubelet[1593]: E0930 07:22:23.177160 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5ce955191eb840a685f92bfd411be0559381a6a733ff511aad8d63b77582cb8b\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.036489 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.067387 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.096310 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.130548 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.171886 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.204131 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.236280 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.236310 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.236330 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:27 kc05 kubelet[1593]: W0930 07:22:27.236347 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:28 kc05 containerd[1478]: time="2024-09-30T07:22:28.999171980Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:28.999280701Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:28.999785003Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:28.999839350Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:28.999912960Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.000206077Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.000391470Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.000773655Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.000822491Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.001202 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.003003 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.009450791Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.009497043Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.009954054Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.010003186Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.010082200Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.010480849Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:22:29 kc05 systemd[1]: run-netns-cni\x2d84ec8330\x2d004b\x2d1135\x2d2b47\x2d67eb3f077222.mount: Deactivated successfully. Sep 30 07:22:29 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371-shm.mount: Deactivated successfully. Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.389917626Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.390416 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.390588 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.390648 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.390754 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a0395c3e5aa79e505da4742e5552708333cf7d9c47c58c03c74742e4fe881371\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:22:29 kc05 containerd[1478]: time="2024-09-30T07:22:29.421191773Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.421527 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.421622 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.421684 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.421791 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:22:29 kc05 kubelet[1593]: I0930 07:22:29.998067 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:22:29 kc05 kubelet[1593]: E0930 07:22:29.998333 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:22:30 kc05 systemd[1]: run-netns-cni\x2d4a00aa88\x2d8aa0\x2d2107\x2da20a\x2df73f80ff4990.mount: Deactivated successfully. Sep 30 07:22:30 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-1d1391ba7de984a35c380202eac1b88b0382790246b2a1526576542554eb6c70-shm.mount: Deactivated successfully. Sep 30 07:22:33 kc05 kubelet[1593]: I0930 07:22:33.998094 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:22:33 kc05 kubelet[1593]: E0930 07:22:33.998456 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:22:34 kc05 containerd[1478]: time="2024-09-30T07:22:34.998939229Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:22:34 kc05 containerd[1478]: time="2024-09-30T07:22:34.999080653Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.024202352Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.024251254Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.025067127Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:22:35 kc05 systemd[1]: run-netns-cni\x2dbc53e69c\x2d9d8d\x2d8101\x2de8b9\x2db74ccbd07a0c.mount: Deactivated successfully. Sep 30 07:22:35 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d-shm.mount: Deactivated successfully. Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.164586493Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:35 kc05 kubelet[1593]: E0930 07:22:35.164897 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:35 kc05 kubelet[1593]: E0930 07:22:35.165009 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:35 kc05 kubelet[1593]: E0930 07:22:35.165052 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:35 kc05 kubelet[1593]: E0930 07:22:35.165133 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e9c00d6aca726703db0e4c08bb44b68708aef7136cca7dd7d5cd50593b17c31d\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.999045246Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:22:35 kc05 containerd[1478]: time="2024-09-30T07:22:35.999158105Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:36 kc05 containerd[1478]: time="2024-09-30T07:22:36.008119907Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:22:36 kc05 containerd[1478]: time="2024-09-30T07:22:36.008184494Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:22:36 kc05 containerd[1478]: time="2024-09-30T07:22:36.009014166Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:22:36 kc05 systemd[1]: run-netns-cni\x2d01e97e47\x2dfdb5\x2ddb00\x2da686\x2de3540b338ed6.mount: Deactivated successfully. Sep 30 07:22:36 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480-shm.mount: Deactivated successfully. Sep 30 07:22:36 kc05 containerd[1478]: time="2024-09-30T07:22:36.160453703Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:36 kc05 kubelet[1593]: E0930 07:22:36.160928 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:36 kc05 kubelet[1593]: E0930 07:22:36.161136 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:36 kc05 kubelet[1593]: E0930 07:22:36.161198 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:36 kc05 kubelet[1593]: E0930 07:22:36.161293 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"acb66a568cdef2f5cfed5a6601fe44227b29275bbcc8125fb3a64d49b6668480\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.035330 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.067957 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.101510 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.137349 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.166144 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.198373 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.198402 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.198417 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.198430 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:37 kc05 kubelet[1593]: W0930 07:22:37.228552 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:40 kc05 kubelet[1593]: W0930 07:22:40.263342 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:22:40 kc05 kubelet[1593]: E0930 07:22:40.263404 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998437507Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998549645Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998641528Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998684687Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998685512Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.998791976Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.999019984Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.999061555Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:41 kc05 containerd[1478]: time="2024-09-30T07:22:41.999099718Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.007907693Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.007959319Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.008779013Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.008969260Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.009023936Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.009785865Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:22:42 kc05 systemd[1]: run-netns-cni\x2db5d9fd70\x2dcc12\x2d376f\x2d3a36\x2d6da1ca37c36c.mount: Deactivated successfully. Sep 30 07:22:42 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e-shm.mount: Deactivated successfully. Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.531296787Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.531703 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.531833 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.531858 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.531913 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"10daea8194978bed532392827965b818d80ee3978eeaa7e58b9f1d5a7f48bb0e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:22:42 kc05 containerd[1478]: time="2024-09-30T07:22:42.553213100Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.553507 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.553579 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.553613 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.553669 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:22:42 kc05 kubelet[1593]: I0930 07:22:42.998295 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.998583 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:22:42 kc05 kubelet[1593]: E0930 07:22:42.999764 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:22:43 kc05 kubelet[1593]: E0930 07:22:43.001064 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:22:43 kc05 systemd[1]: run-netns-cni\x2d97ea9638\x2ded92\x2d7af9\x2d4ed2\x2db358d87a0927.mount: Deactivated successfully. Sep 30 07:22:43 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e01848057d5f0842d3510b611e9ed4fe1b069fc5ef55564fb659526ab5bfea8c-shm.mount: Deactivated successfully. Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.007727306Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.007831444Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.032692964Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.032743341Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.033524862Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.037664 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.064847 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.093433 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.123103 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 systemd[1]: run-netns-cni\x2d947c6727\x2d72b5\x2de955\x2db24e\x2da3801e9d2784.mount: Deactivated successfully. Sep 30 07:22:47 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48-shm.mount: Deactivated successfully. Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.148065 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.175189 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.175223 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.175237 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.175250 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:47 kc05 containerd[1478]: time="2024-09-30T07:22:47.175842192Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:47 kc05 kubelet[1593]: E0930 07:22:47.176227 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:47 kc05 kubelet[1593]: E0930 07:22:47.176331 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:47 kc05 kubelet[1593]: E0930 07:22:47.176382 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:47 kc05 kubelet[1593]: E0930 07:22:47.176471 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"787f6158fb6e8dbe3fcf46ad50c1e216a20e06fe4d310363f7b2b7e5b6a6ed48\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:22:47 kc05 kubelet[1593]: W0930 07:22:47.205551 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:47 kc05 kubelet[1593]: I0930 07:22:47.998519 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:22:47 kc05 kubelet[1593]: E0930 07:22:47.998835 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:22:49 kc05 containerd[1478]: time="2024-09-30T07:22:49.999088777Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:22:50 kc05 containerd[1478]: time="2024-09-30T07:22:49.999197298Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:50 kc05 containerd[1478]: time="2024-09-30T07:22:50.008712395Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:22:50 kc05 containerd[1478]: time="2024-09-30T07:22:50.008768397Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:22:50 kc05 containerd[1478]: time="2024-09-30T07:22:50.009497593Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:22:50 kc05 systemd[1]: run-netns-cni\x2d1ade5b90\x2d838d\x2df186\x2d195d\x2df5a473bf9812.mount: Deactivated successfully. Sep 30 07:22:50 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5-shm.mount: Deactivated successfully. Sep 30 07:22:50 kc05 containerd[1478]: time="2024-09-30T07:22:50.165503127Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:50 kc05 kubelet[1593]: E0930 07:22:50.165875 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:50 kc05 kubelet[1593]: E0930 07:22:50.165976 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:50 kc05 kubelet[1593]: E0930 07:22:50.166057 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:22:50 kc05 kubelet[1593]: E0930 07:22:50.166153 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"23305dc4d1575bf153bd2e64668a0a0708657bffb39c894bcb357359c3cc40a5\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:22:52 kc05 containerd[1478]: time="2024-09-30T07:22:52.998966565Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:52.999095549Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:52.999179849Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:52.999215595Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:53.008526345Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:53.008576349Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:53.009288073Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:22:53 kc05 systemd[1]: run-netns-cni\x2ddaeb513c\x2d6105\x2d3d5d\x2d9082\x2dbf98948b1ea3.mount: Deactivated successfully. Sep 30 07:22:53 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745-shm.mount: Deactivated successfully. Sep 30 07:22:53 kc05 containerd[1478]: time="2024-09-30T07:22:53.122426660Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:53 kc05 kubelet[1593]: E0930 07:22:53.122747 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:53 kc05 kubelet[1593]: E0930 07:22:53.122824 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:53 kc05 kubelet[1593]: E0930 07:22:53.122865 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:22:53 kc05 kubelet[1593]: E0930 07:22:53.122943 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"58368e602c4ff63b327df4135c56583b5c1d80f3f5a844324c039c4fcfac7745\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.007194670Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.007299212Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.007393460Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.007435022Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.007478085Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.007472 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.008679 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.016187621Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.016229654Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.016932538Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.044698 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.079366 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.106421 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 systemd[1]: run-netns-cni\x2df54a5567\x2db5c0\x2dcb6f\x2d735e\x2d7ea7a3acbbea.mount: Deactivated successfully. Sep 30 07:22:57 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464-shm.mount: Deactivated successfully. Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.138649 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.138681 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.138695 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.138709 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:22:57 kc05 containerd[1478]: time="2024-09-30T07:22:57.153620402Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.153973 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.154093 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.154147 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.154231 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e10bd57beed5dd7ef53dcf7a72a7f006e3a1fc432c42e20bc258a62365154464\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.169489 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.197060 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: W0930 07:22:57.227148 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:22:57 kc05 kubelet[1593]: I0930 07:22:57.998474 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:22:57 kc05 kubelet[1593]: E0930 07:22:57.998750 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:22:58 kc05 kubelet[1593]: I0930 07:22:58.999093 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:22:58 kc05 kubelet[1593]: E0930 07:22:58.999440 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:58.999287041Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:58.999394915Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:59.024532590Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:59.024590007Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:59.025369399Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:22:59 kc05 systemd[1]: run-netns-cni\x2d85105750\x2d1754\x2da63b\x2ddccb\x2dc05e310423d3.mount: Deactivated successfully. Sep 30 07:22:59 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260-shm.mount: Deactivated successfully. Sep 30 07:22:59 kc05 containerd[1478]: time="2024-09-30T07:22:59.193303230Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:59 kc05 kubelet[1593]: E0930 07:22:59.193615 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:22:59 kc05 kubelet[1593]: E0930 07:22:59.193688 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:59 kc05 kubelet[1593]: E0930 07:22:59.193726 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:22:59 kc05 kubelet[1593]: E0930 07:22:59.193785 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b507d028a898f26c2ac358537aae7770d98c15fab3af7f61ac7d02545c882260\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:23:01 kc05 containerd[1478]: time="2024-09-30T07:23:01.999115845Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:23:02 kc05 containerd[1478]: time="2024-09-30T07:23:01.999221656Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:02 kc05 containerd[1478]: time="2024-09-30T07:23:02.010242093Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:23:02 kc05 containerd[1478]: time="2024-09-30T07:23:02.010303328Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:23:02 kc05 containerd[1478]: time="2024-09-30T07:23:02.011223468Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:23:02 kc05 systemd[1]: run-netns-cni\x2d346000a8\x2d525c\x2dfe3f\x2d1b16\x2d5099f4e01ba8.mount: Deactivated successfully. Sep 30 07:23:02 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08-shm.mount: Deactivated successfully. Sep 30 07:23:02 kc05 containerd[1478]: time="2024-09-30T07:23:02.151489358Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:02 kc05 kubelet[1593]: E0930 07:23:02.151842 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:02 kc05 kubelet[1593]: E0930 07:23:02.151934 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:02 kc05 kubelet[1593]: E0930 07:23:02.151977 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:02 kc05 kubelet[1593]: E0930 07:23:02.152064 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5f8c54316c5837d72a50d22a0d5a3a2d2773b4df2da69c65457de6457038fc08\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:23:05 kc05 containerd[1478]: time="2024-09-30T07:23:05.999291478Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:05.999396544Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:05.999484542Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:05.999521073Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:06.009923640Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:06.009980115Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:06.010793896Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:23:06 kc05 systemd[1]: run-netns-cni\x2d110b3e45\x2d572c\x2d4c49\x2d1be5\x2d65302ad280e0.mount: Deactivated successfully. Sep 30 07:23:06 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2-shm.mount: Deactivated successfully. Sep 30 07:23:06 kc05 containerd[1478]: time="2024-09-30T07:23:06.178360419Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:06 kc05 kubelet[1593]: E0930 07:23:06.178718 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:06 kc05 kubelet[1593]: E0930 07:23:06.178823 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:06 kc05 kubelet[1593]: E0930 07:23:06.178875 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:06 kc05 kubelet[1593]: E0930 07:23:06.178974 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"042b4132590aa45aec6905faeabb1e6d89094d3f0774f6977311ad5566a00ea2\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.033259 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.061660 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.091935 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.128609 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.154759 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.190556 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.190582 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.190596 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.190609 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:23:07 kc05 kubelet[1593]: W0930 07:23:07.222881 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:07 kc05 kubelet[1593]: E0930 07:23:07.999100 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:23:08 kc05 kubelet[1593]: E0930 07:23:08.000324 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:23:09 kc05 kubelet[1593]: I0930 07:23:08.999686 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:23:09 kc05 kubelet[1593]: E0930 07:23:09.000132 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.000460599Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.000585181Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.000714707Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.000760173Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.000804494Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.009628791Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.009680615Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.010415097Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:23:09 kc05 systemd[1]: run-netns-cni\x2d19a97df2\x2d0fb0\x2d5ddc\x2d9545\x2d36c904a472e0.mount: Deactivated successfully. Sep 30 07:23:09 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01-shm.mount: Deactivated successfully. Sep 30 07:23:09 kc05 containerd[1478]: time="2024-09-30T07:23:09.144179859Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:09 kc05 kubelet[1593]: E0930 07:23:09.144610 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:09 kc05 kubelet[1593]: E0930 07:23:09.144720 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:09 kc05 kubelet[1593]: E0930 07:23:09.144775 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:09 kc05 kubelet[1593]: E0930 07:23:09.144865 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9247e07c5eb42ab8e8ce4a02abe33fa26d7a0bd5dfe7c7ff636e26dfe7342d01\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:23:11 kc05 kubelet[1593]: I0930 07:23:11.998758 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:23:11 kc05 kubelet[1593]: E0930 07:23:11.999078 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:23:13 kc05 containerd[1478]: time="2024-09-30T07:23:13.998943530Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:23:13 kc05 containerd[1478]: time="2024-09-30T07:23:13.999085190Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:13 kc05 containerd[1478]: time="2024-09-30T07:23:13.999233586Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:23:13 kc05 containerd[1478]: time="2024-09-30T07:23:13.999328097Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.009476719Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.009528357Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.010357172Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.023738501Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.023807638Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.024733736Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:23:14 kc05 systemd[1]: run-netns-cni\x2dc612385b\x2df8ad\x2dd0a0\x2d56c5\x2dafefe58e31fe.mount: Deactivated successfully. Sep 30 07:23:14 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347-shm.mount: Deactivated successfully. Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.388742406Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.389177 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.389307 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.389374 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.389489 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"89d2950f92370a6a0c3f9b4e30c6d45e14f3b86e346f11f2561a1ee64e2a8347\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:23:14 kc05 containerd[1478]: time="2024-09-30T07:23:14.451202392Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.451531 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.451624 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.451674 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:14 kc05 kubelet[1593]: E0930 07:23:14.451760 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:23:15 kc05 systemd[1]: run-netns-cni\x2d77fcea40\x2dca3a\x2dcd79\x2d9710\x2da2e9b17c323f.mount: Deactivated successfully. Sep 30 07:23:15 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8ca398d8329594ca76eada52c9615818d76b433486970c57037f16c54770b33d-shm.mount: Deactivated successfully. Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.040483 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.071169 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.098601 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.132427 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.168638 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.199802 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.231966 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.232012 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.232026 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:23:17 kc05 kubelet[1593]: W0930 07:23:17.232039 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:23:18 kc05 containerd[1478]: time="2024-09-30T07:23:18.999344588Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:18.999454947Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:18.999554495Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:18.999590772Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:19.008490342Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:19.008529725Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:19.009123145Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:23:19 kc05 systemd[1]: run-netns-cni\x2df32134ca\x2dbd10\x2dc6d9\x2d0e8d\x2de37167c2ca96.mount: Deactivated successfully. Sep 30 07:23:19 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5-shm.mount: Deactivated successfully. Sep 30 07:23:19 kc05 containerd[1478]: time="2024-09-30T07:23:19.155376745Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:19 kc05 kubelet[1593]: E0930 07:23:19.155770 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:19 kc05 kubelet[1593]: E0930 07:23:19.155886 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:19 kc05 kubelet[1593]: E0930 07:23:19.155940 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:19 kc05 kubelet[1593]: E0930 07:23:19.156063 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7710290dbac0ae48f888ab416937230ab1df0b887c16105db0aa9a81a3bec3c5\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:23:21 kc05 kubelet[1593]: E0930 07:23:21.999762 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:23:22 kc05 kubelet[1593]: E0930 07:23:22.001059 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:23:23 kc05 kubelet[1593]: I0930 07:23:23.998764 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:23:23 kc05 kubelet[1593]: E0930 07:23:23.999078 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-proxy pod=kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99)\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:23.999470647Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:23.999574508Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:23.999660815Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:23.999696666Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:23.999732572Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:24.008976442Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:24.009035758Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:24.009767070Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:23:24 kc05 systemd[1]: run-netns-cni\x2d854123fa\x2da659\x2dd13a\x2d5021\x2d2942c72ac578.mount: Deactivated successfully. Sep 30 07:23:24 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f-shm.mount: Deactivated successfully. Sep 30 07:23:24 kc05 containerd[1478]: time="2024-09-30T07:23:24.153033033Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:24 kc05 kubelet[1593]: E0930 07:23:24.153388 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:24 kc05 kubelet[1593]: E0930 07:23:24.153463 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:24 kc05 kubelet[1593]: E0930 07:23:24.153503 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:24 kc05 kubelet[1593]: E0930 07:23:24.153582 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"46c1813d569d87711f5b580c43c2710deaf2cafe6e0c01600d00f57c86efb75f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5" Sep 30 07:23:24 kc05 kubelet[1593]: I0930 07:23:24.998605 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:23:24 kc05 kubelet[1593]: E0930 07:23:24.998902 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=node-exporter pod=prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1)\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.037139 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.067346 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.098264 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.132423 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.172567 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.201856 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.233294 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.233315 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.233326 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:23:27 kc05 kubelet[1593]: W0930 07:23:27.233337 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:23:27 kc05 containerd[1478]: time="2024-09-30T07:23:27.998765479Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\"" Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:27.998869301Z" level=info msg="Container to stop \"95cba235fdf3dd5c661003558e973f6063da0210651656869839059af87a1a92\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:28.022495292Z" level=info msg="TearDown network for sandbox \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" successfully" Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:28.022544277Z" level=info msg="StopPodSandbox for \"676706b78dfcff3fa680fa3cbef7a1c1d317a2622ca7aa0c6877ca72ff4cc84b\" returns successfully" Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:28.023396720Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,}" Sep 30 07:23:28 kc05 systemd[1]: run-netns-cni\x2dc2a49979\x2dcbd6\x2dce08\x2d274a\x2de5a39d083202.mount: Deactivated successfully. Sep 30 07:23:28 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5-shm.mount: Deactivated successfully. Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:28.197891174Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:loki-promtail-wghkq,Uid:851b5147-7511-4641-91f3-1e01dd5fdb50,Namespace:dxinf-monitoring,Attempt:8,} failed, error" error="failed to setup network for sandbox \"a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:28 kc05 kubelet[1593]: E0930 07:23:28.198291 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:28 kc05 kubelet[1593]: E0930 07:23:28.198401 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:23:28 kc05 kubelet[1593]: E0930 07:23:28.198454 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="dxinf-monitoring/loki-promtail-wghkq" Sep 30 07:23:28 kc05 kubelet[1593]: E0930 07:23:28.198551 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"loki-promtail-wghkq_dxinf-monitoring(851b5147-7511-4641-91f3-1e01dd5fdb50)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a58cdfe875e664430445a918122954f2abe7bfdffeef9da69ec579e0332897f5\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="dxinf-monitoring/loki-promtail-wghkq" podUID="851b5147-7511-4641-91f3-1e01dd5fdb50" Sep 30 07:23:28 kc05 containerd[1478]: time="2024-09-30T07:23:28.999158771Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\"" Sep 30 07:23:29 kc05 containerd[1478]: time="2024-09-30T07:23:28.999290819Z" level=info msg="Container to stop \"fac8faf35e77b72d6a2606679d54a03678fa12350b733d4ac1938d6df11d489f\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:29 kc05 containerd[1478]: time="2024-09-30T07:23:29.009072780Z" level=info msg="TearDown network for sandbox \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" successfully" Sep 30 07:23:29 kc05 containerd[1478]: time="2024-09-30T07:23:29.009120513Z" level=info msg="StopPodSandbox for \"5768b4a28f036547a84f78d07df8309fe352b1c54434f1515139ec9b24b11c76\" returns successfully" Sep 30 07:23:29 kc05 containerd[1478]: time="2024-09-30T07:23:29.009816489Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,}" Sep 30 07:23:29 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444-shm.mount: Deactivated successfully. Sep 30 07:23:29 kc05 containerd[1478]: time="2024-09-30T07:23:29.141536216Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:kured-gk6ff,Uid:4068edf6-a44a-460e-aab4-aac9ad87c23c,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:29 kc05 kubelet[1593]: E0930 07:23:29.141977 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:29 kc05 kubelet[1593]: E0930 07:23:29.142087 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:29 kc05 kubelet[1593]: E0930 07:23:29.142134 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/kured-gk6ff" Sep 30 07:23:29 kc05 kubelet[1593]: E0930 07:23:29.142213 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kured-gk6ff_kube-system(4068edf6-a44a-460e-aab4-aac9ad87c23c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bc7f68019e3facebc504914c9137a681620922d5d302af0f17a7ea0df17ae444\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/kured-gk6ff" podUID="4068edf6-a44a-460e-aab4-aac9ad87c23c" Sep 30 07:23:33 kc05 kubelet[1593]: E0930 07:23:32.999935 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="init container &Container{Name:install-cni-plugin,Image:docker.io/flannel/flannel-cni-plugin:v1.5.1-flannel2,Command:[cp],Args:[-f /flannel /opt/cni/bin/flannel],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-plugin,ReadOnly:false,MountPath:/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nljfs,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-flannel-ds-nvkgc_kube-flannel(0b06a017-c2c3-452e-88ba-a0422996cf87): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:23:33 kc05 kubelet[1593]: E0930 07:23:33.001205 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"install-cni-plugin\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-flannel/kube-flannel-ds-nvkgc" podUID="0b06a017-c2c3-452e-88ba-a0422996cf87" Sep 30 07:23:34 kc05 kubelet[1593]: I0930 07:23:34.998409 1593 scope.go:117] "RemoveContainer" containerID="0d102455d6fce562bba717687fa11efb5e0a51e02e7b4d88370b610f593727f3" Sep 30 07:23:34 kc05 containerd[1478]: time="2024-09-30T07:23:34.999129828Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\"" Sep 30 07:23:34 kc05 containerd[1478]: time="2024-09-30T07:23:34.999238662Z" level=info msg="Container to stop \"70d572b6caafb72a45803a45a5d27dea14428e85513a801eb469bbde35b4c3cc\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:34 kc05 containerd[1478]: time="2024-09-30T07:23:34.999325657Z" level=info msg="Container to stop \"07622e453d153e8fec6eaca660c18efb83b0efc520b3cf3559b0bb40faec3d36\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:34 kc05 containerd[1478]: time="2024-09-30T07:23:34.999362912Z" level=info msg="Container to stop \"442025b1f570088266de1bbfc67973b81d2e3e1c4dd110773732240b0bf92d21\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:34.999800 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:kube-proxy,Image:registry.k8s.io/kube-proxy:v1.25.16,Command:[/usr/local/bin/kube-proxy --config=/var/lib/kube-proxy/config.conf --hostname-override=$(NODE_NAME)],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-proxy,ReadOnly:false,MountPath:/var/lib/kube-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4twk4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-proxy-qmm2l_kube-system(0344fcf8-42dc-437f-a79a-7b6dbd23ab99): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:35.001161 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="kube-system/kube-proxy-qmm2l" podUID="0344fcf8-42dc-437f-a79a-7b6dbd23ab99" Sep 30 07:23:35 kc05 containerd[1478]: time="2024-09-30T07:23:35.008315000Z" level=info msg="TearDown network for sandbox \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" successfully" Sep 30 07:23:35 kc05 containerd[1478]: time="2024-09-30T07:23:35.008367133Z" level=info msg="StopPodSandbox for \"4c6e1a13d20a319d69ca1de1ac841ef6f580736223e8625b22f5172c0270b2c1\" returns successfully" Sep 30 07:23:35 kc05 containerd[1478]: time="2024-09-30T07:23:35.008986084Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,}" Sep 30 07:23:35 kc05 systemd[1]: run-netns-cni\x2ddcbf952d\x2d2b44\x2dd6d3\x2d4a85\x2d7d02d75383cb.mount: Deactivated successfully. Sep 30 07:23:35 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e-shm.mount: Deactivated successfully. Sep 30 07:23:35 kc05 containerd[1478]: time="2024-09-30T07:23:35.156008281Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:legacy-node-server-z9bps,Uid:8a78aeaf-f234-4b2a-a18c-54259e81dfa1,Namespace:directpv,Attempt:9,} failed, error" error="failed to setup network for sandbox \"6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:35.156437 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:35.156522 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:35.156563 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/legacy-node-server-z9bps" Sep 30 07:23:35 kc05 kubelet[1593]: E0930 07:23:35.156635 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"legacy-node-server-z9bps_directpv(8a78aeaf-f234-4b2a-a18c-54259e81dfa1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6717ea3978ed25a6c8c1c44e624e52a109ccfab1f899d4c8f63a2ef178a5d63e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/legacy-node-server-z9bps" podUID="8a78aeaf-f234-4b2a-a18c-54259e81dfa1" Sep 30 07:23:36 kc05 kubelet[1593]: W0930 07:23:36.910597 1593 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: "spec.clusterIP" is not a known field selector: only "metadata.name", "metadata.namespace" Sep 30 07:23:36 kc05 kubelet[1593]: E0930 07:23:36.910677 1593 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: \"spec.clusterIP\" is not a known field selector: only \"metadata.name\", \"metadata.namespace\"" logger="UnhandledError" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.039315 1593 warnings.go:70] unknown field "status.containerStatuses[0].volumeMounts" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.039364 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.039379 1593 warnings.go:70] unknown field "status.initContainerStatuses[0].volumeMounts" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.039392 1593 warnings.go:70] unknown field "status.initContainerStatuses[1].volumeMounts" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.069809 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.100897 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.133944 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.167337 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.205892 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: W0930 07:23:37.237979 1593 warnings.go:70] unknown field "status.hostIPs" Sep 30 07:23:37 kc05 kubelet[1593]: I0930 07:23:37.998769 1593 scope.go:117] "RemoveContainer" containerID="4f1117ed13acf659c87f65224375fa3c83e01d4b5afe77ca51307a39ef6332a6" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.000408845Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\"" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.615390441Z" level=info msg="ImageUpdate event name:\"quay.io/prometheus/node-exporter:v1.7.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.621291440Z" level=info msg="stop pulling image quay.io/prometheus/node-exporter:v1.7.0: active requests=0, bytes read=0" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.628983090Z" level=info msg="Pulled image \"quay.io/prometheus/node-exporter:v1.7.0\" with image id \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", repo tag \"quay.io/prometheus/node-exporter:v1.7.0\", repo digest \"quay.io/prometheus/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", size \"11777109\" in 628.482363ms" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.629074829Z" level=info msg="PullImage \"quay.io/prometheus/node-exporter:v1.7.0\" returns image reference \"sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\"" Sep 30 07:23:38 kc05 kubelet[1593]: E0930 07:23:38.630061 1593 kuberuntime_manager.go:1272] "Unhandled Error" err="container &Container{Name:node-exporter,Image:quay.io/prometheus/node-exporter:v1.7.0,Command:[],Args:[--path.procfs=/host/proc --path.sysfs=/host/sys --path.rootfs=/host/root --no-collector.fibrechannel --no-collector.infiniband --no-collector.nfs --no-collector.wifi --collector.filesystem.mount-points-exclude=^/(run|dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/pods/.+|run/.+)($|/) --collector.netclass.ignored-devices=^(veth.*|docker.*|virbr.*|vnet.*|flannel.*|cni.*|lo|tmpfs)$],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9100,ContainerPort:9100,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {} 100m DecimalSI},memory: {{31457280 0} {} 30Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proc,ReadOnly:true,MountPath:/host/proc,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:sys,ReadOnly:true,MountPath:/host/sys,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:root,ReadOnly:true,MountPath:/host/root,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n5s57,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod prometheus-node-exporter-mdpwn_dxinf-monitoring(a2e9d01b-4bfa-446d-9897-71be4ebadea1): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Sep 30 07:23:38 kc05 kubelet[1593]: E0930 07:23:38.631249 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-exporter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="dxinf-monitoring/prometheus-node-exporter-mdpwn" podUID="a2e9d01b-4bfa-446d-9897-71be4ebadea1" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.998488510Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\"" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.998601270Z" level=info msg="Container to stop \"d836bd9bc2945f741ae45b3338433031e3d69044ca9e60502321bf545c1d2358\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.998704790Z" level=info msg="Container to stop \"7da6925fb592a30519fe02c7a563f16ca04fda563bed72d6514a63c35a20a89c\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.998752949Z" level=info msg="Container to stop \"b5c04574a08b917f7b54147689c227e967d38576ecac8ddaaa914eef832765a6\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:38 kc05 containerd[1478]: time="2024-09-30T07:23:38.998804271Z" level=info msg="Container to stop \"0f3e8385fc850ecf2d900e7903970b61342c2b77be7cd466ff08db28a24ad6c2\" must be in running or unknown state, current state \"CONTAINER_EXITED\"" Sep 30 07:23:39 kc05 containerd[1478]: time="2024-09-30T07:23:39.008856381Z" level=info msg="TearDown network for sandbox \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" successfully" Sep 30 07:23:39 kc05 containerd[1478]: time="2024-09-30T07:23:39.008899906Z" level=info msg="StopPodSandbox for \"d9ffd811bb4e0ff5ef60080ee996fbac1b171f3c6e0b333cf5ca9a243de3081b\" returns successfully" Sep 30 07:23:39 kc05 containerd[1478]: time="2024-09-30T07:23:39.009609290Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,}" Sep 30 07:23:39 kc05 systemd[1]: run-netns-cni\x2de18d1423\x2dabc0\x2d6eed\x2d643c\x2dcace7c92ffc6.mount: Deactivated successfully. Sep 30 07:23:39 kc05 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff-shm.mount: Deactivated successfully. Sep 30 07:23:39 kc05 containerd[1478]: time="2024-09-30T07:23:39.162140119Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:node-server-gs7wg,Uid:d5c37209-3eda-4a25-aec1-2449ac6ac6f5,Namespace:directpv,Attempt:8,} failed, error" error="failed to setup network for sandbox \"7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:39 kc05 kubelet[1593]: E0930 07:23:39.162634 1593 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" Sep 30 07:23:39 kc05 kubelet[1593]: E0930 07:23:39.162724 1593 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:39 kc05 kubelet[1593]: E0930 07:23:39.162765 1593 kuberuntime_manager.go:1168] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="directpv/node-server-gs7wg" Sep 30 07:23:39 kc05 kubelet[1593]: E0930 07:23:39.162839 1593 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"node-server-gs7wg_directpv(d5c37209-3eda-4a25-aec1-2449ac6ac6f5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7c85fa691eb22e1205bdfe76250acf6f0562e966b2ca6d44cbdcc970ee3de1ff\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="directpv/node-server-gs7wg" podUID="d5c37209-3eda-4a25-aec1-2449ac6ac6f5"