Running DPDK APP

[infinitydon]

Hi,

I am currently trying to test running dpdk apps on talos, I have the following worker machine config:

    kernel:
     modules:
     - name: vfio_pci

    install:
        # # Allows for supplying extra kernel args via the bootloader.
        extraKernelArgs:
        - "vfio-pci.enable_unsafe_noiommu_mode=1"
        - "hugepagesz=1G"
        - "hugepages=4"

    udev:
     rules:
     - SUBSYSTEM=="pci", KERNELS=="0000:00:13.0", DRIVER=="", ATTR{driver_override}="vfio-pci"
     - SUBSYSTEM=="pci", KERNELS=="0000:00:14.0", DRIVER=="", ATTR{driver_override}="vfio-pci"

I am able to see the hugepages when I desribe the workernode but I am still seeing the 2 ethernet NICs 0000:00:13.0 and 0000:00:14.0 when I run talosctl get links, usually when an interface is assigned to vfio-pci driver it will no longer visible at the kernel level

I need help to confirm if the above config is correct or suggestions on how to get it working.

Thanks

[jarrodb]

I just ran into the same thing @infinitydon .. you figure this out?

[jarrodb]

@infinitydon we ended up writing an extension that performed the unbind from the default driver (i.e. ixgbe) and bind to vfio-pci with writeableSysfs: true explicitly set.

[infinitydon]

Thanks @jarrodb - If possible can you share details about the extension you built so I can use it to build mine (I will be unbinding from virtio driver)

[jarrodb]

See this thread on Slack: https://taloscommunity.slack.com/archives/CG25RPZNE/p1728066098113309

We'll be submitting this extension via PR very soon which keys off the kernel cmdline like this:

        extraKernelArgs:
        - pcirebind.rebind=0000:04:00.0_ixgbe+vfio-pci

In our instance it unbinds 0000:04:00.0 from ixgbe and rebinds to vfio-pci

[infinitydon]

Ok, will be on the look out for the PR. Thanks!