NVJPEG does not work, -d nvjpeg does not show anything

[Rush-iam]

I am upgrading from Xpra 5.0.3 to 6.0.
I found NVJPEG compression is not working for me in 6.0.
I remember it can be debugged with -d nvjpeg, but it does not produce any debug output.
-d compress shows basic jpeg/webp compression codecs are used.
-d nvenc works fine and passes all the checks and I also see this successful init in the start-up log:

2024-05-02 22:52:15,570 CUDA initialization (this may take a few seconds)       
2024-05-02 22:52:15,667 loaded 2 start menu entries from 1 sub-menus in 0.4 seconds                                                                             
2024-05-02 22:52:15,695 CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:           
2024-05-02 22:52:15,695   + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)                                                                            
2024-05-02 22:52:15,764 NVidia driver version 470.182.3                         
2024-05-02 22:52:15,900 NVENC v11 successfully initialized with codecs: h264, h265

[totaam]

Please include more details as per https://github.com/Xpra-org/xpra/wiki/Reporting-Bugs
The output of xpra encoding and xpra video would help.

[Rush-iam]

6.0 xpra encoding:

CUDA initialization (this may take a few seconds)
CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:
  + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
Error querying drm devices: -2
modules found:
* csc_cython           : No module named 'xpra.codecs.csc_cython'
* csc_libyuv           : No module named 'xpra.codecs.libyuv'
* dec_avif             : No module named 'xpra.codecs.avif'
* dec_gstreamer        : No module named 'xpra.codecs.gstreamer'
* dec_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/decoder.cpython-310-x86_64-linux-gnu.so
* dec_nvjpeg           : libnvjpeg.so.12: cannot open shared object file: No such file or directory
* dec_openh264         : /usr/lib/python3/dist-packages/xpra/codecs/openh264/decoder.cpython-310-x86_64-linux-gnu.so
* dec_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/decoder.py
* dec_spng             : No module named 'xpra.codecs.spng'
* dec_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/decoder.cpython-310-x86_64-linux-gnu.so
* dec_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/decoder.cpython-310-x86_64-linux-gnu.so
* drm                  : /usr/lib/python3/dist-packages/xpra/codecs/drm/drm.cpython-310-x86_64-linux-gnu.so
* enc_avif             : No module named 'xpra.codecs.avif'
* enc_gstreamer        : No module named 'xpra.codecs.gstreamer'
* enc_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/encoder.cpython-310-x86_64-linux-gnu.so
* enc_nvjpeg           : libnvjpeg.so.12: cannot open shared object file: No such file or directory
* enc_openh264         : /usr/lib/python3/dist-packages/xpra/codecs/openh264/encoder.cpython-310-x86_64-linux-gnu.so
* enc_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/encoder.py
* enc_rgb              : /usr/lib/python3/dist-packages/xpra/codecs/argb/encoder.py
* enc_spng             : No module named 'xpra.codecs.spng'
* enc_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/encoder.cpython-310-x86_64-linux-gnu.so
* enc_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/encoder.cpython-310-x86_64-linux-gnu.so
* enc_x264             : /usr/lib/python3/dist-packages/xpra/codecs/x264/encoder.cpython-310-x86_64-linux-gnu.so
* evdi                 : No module named 'xpra.codecs.evdi'
* nvdec                : No module named 'xpra.codecs.nvidia.nvdec'
* nvenc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvenc/encoder.cpython-310-x86_64-linux-gnu.so
* nvfbc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvfbc/capture_linux.cpython-310-x86_64-linux-gnu.so
* v4l2                 : /usr/lib/python3/dist-packages/xpra/codecs/v4l2/virtual.cpython-310-x86_64-linux-gnu.so

codecs versions:
* drm                             : 4.4
* jpeg                            : 1.0
* numpy                           : 1.22.3
* nvenc                           : 11.0
* nvfbc                           : 1.7
* openh264                        : 2.2.0
* pillow                          : 9.5.0
* rgb                             : 6.0
* v4l2                            : 1.0
* vpx                             : 1.11.0
* webp                            : 1.2.2
* x264                            : 163

6.0 xpra video:

CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:
  + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
* csc
* decoding
  - h264_to_YUV420P               : openh264
  - vp8_to_YUV420P                : vpx
  - vp9_to_YUV420P                : vpx
  - vp9_to_YUV444P                : vpx
* encoding
  - ARGB_to_h264                  : nvenc
  - ARGB_to_h265                  : nvenc
  - BGR48_to_h264                 : x264
  - BGRA_to_jpega                 : jpeg
  - BGRA_to_webp                  : webp
  - BGRX_to_h264                  : nvenc, x264
  - BGRX_to_h265                  : nvenc
  - BGRX_to_jpeg                  : jpeg
  - BGRX_to_webp                  : webp
  - BGR_to_jpeg                   : jpeg
  - BGR_to_webp                   : webp
  - RGBA_to_jpega                 : jpeg
  - RGBA_to_webp                  : webp
  - RGBX_to_jpeg                  : jpeg
  - RGBX_to_webp                  : webp
  - RGB_to_jpeg                   : jpeg
  - RGB_to_webp                   : webp
  - XBGR_to_jpeg                  : jpeg
  - XRGB_to_h264                  : nvenc
  - XRGB_to_h265                  : nvenc
  - XRGB_to_jpeg                  : jpeg
  - YUV420P_to_h264               : openh264, x264
  - YUV420P_to_jpeg               : jpeg
  - YUV420P_to_vp8                : vpx
  - YUV420P_to_vp9                : vpx
  - YUV422P_to_h264               : x264
  - YUV422P_to_jpeg               : jpeg
  - YUV444P10_to_vp9              : vpx
  - YUV444P_to_h264               : x264
  - YUV444P_to_jpeg               : jpeg
  - YUV444P_to_vp9                : vpx
  - csc-module
    - cython                      : active
    - libyuv                      : active
  - r210_to_h264                  : nvenc
  - r210_to_h265                  : nvenc
  - video-encoder
    - gstreamer                   : active
    - jpeg                        : active
    - nvenc                       : active
    - nvjpeg                      : active
    - openh264                    : active
    - vpx                         : active
    - webp                        : active
    - x264                        : active
* gpu
  - csc                           : ()
  - decodings                     : ()
  - encodings                     : h264, h265

5.0.3 xpra encoding:

CUDA 11.2.0 / PyCUDA 2024.1, found 1 device: 
+ Tesla T4 @ 0000:00:1E.0 (memory: 97% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
Error querying drm devices: -2                                                                           
modules found:
* csc_cython           : No module named 'xpra.codecs.csc_cython'                                        
* csc_libyuv           : No module named 'xpra.codecs.libyuv'                                                   
* csc_swscale          : No module named 'xpra.codecs.ffmpeg'                                                           
* dec_avcodec2         : No module named 'xpra.codecs.ffmpeg'
* dec_avif             : /usr/lib/python3/dist-packages/xpra/codecs/avif/decoder.cpython-310-x86_64-linux-gnu.so        
* dec_gstreamer        : No module named 'xpra.codecs.gstreamer' 
* dec_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/decoder.cpython-310-x86_64-linux-gnu.so
* dec_openh264         : No module named 'xpra.codecs.openh264'                                                 
* dec_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/decoder.py
* dec_spng             : No module named 'xpra.codecs.spng'                                                     
* dec_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/decoder.cpython-310-x86_64-linux-gnu.so
* dec_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/decoder.cpython-310-x86_64-linux-gnu.so        
* drm                  : /usr/lib/python3/dist-packages/xpra/codecs/drm/drm.cpython-310-x86_64-linux-gnu.so              
* enc_avif             : /usr/lib/python3/dist-packages/xpra/codecs/avif/encoder.cpython-310-x86_64-linux-gnu.so
* enc_ffmpeg           : No module named 'xpra.codecs.ffmpeg'                                                         
* enc_gstreamer        : No module named 'xpra.codecs.gstreamer' 
* enc_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/encoder.cpython-310-x86_64-linux-gnu.so         
* enc_nvjpeg           : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvjpeg/encoder.cpython-310-x86_64-linux-gnu.so
* enc_openh264         : No module named 'xpra.codecs.openh264'                                                
* enc_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/encoder.py                          
* enc_rgb              : /usr/lib/python3/dist-packages/xpra/codecs/argb/encoder.py                             
* enc_spng             : No module named 'xpra.codecs.spng'
* enc_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/encoder.cpython-310-x86_64-linux-gnu.so 
* enc_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/encoder.cpython-310-x86_64-linux-gnu.so
* enc_x264             : /usr/lib/python3/dist-packages/xpra/codecs/x264/encoder.cpython-310-x86_64-linux-gnu.so                  
* evdi                 : No module named 'xpra.codecs.evdi'
* nvdec                : No module named 'xpra.codecs.nvidia.nvdec'                                                     
* nvenc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvenc/encoder.cpython-310-x86_64-linux-gnu.so         
* nvfbc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvfbc/fbc_capture_linux.cpython-310-x86_64-linux-gnu.so
* v4l2                 : /usr/lib/python3/dist-packages/xpra/codecs/v4l2/pusher.cpython-310-x86_64-linux-gnu.so
                                                                                
codecs versions:                                                                
* avif                            : 0.9.3                                       
* drm                             : 4.4
* jpeg                            : 1.0 
* numpy                           : 1.22.3  
* nvenc                           : 11.0         
* nvfbc                           : 1.7                                         
* nvjpeg                          : 11.8.0.2                
* pillow                          : 9.5.0                                       
* rgb                             : 4.3                                         
* v4l2                            : 1.0
* vpx                             : 1.11.0                                      
* webp                            : 1.2.2                        * x264                            : 163

5.0.3 xpra video

CUDA 11.2.0 / PyCUDA 2024.1, found 1 device:
  + Tesla T4 @ 0000:00:1E.0 (memory: 97% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
* csc
* decoding
  - vp8_to_YUV420P                : dec_vpx
  - vp9_to_YUV420P                : dec_vpx
  - vp9_to_YUV444P                : dec_vpx
* encoding
  - ARGB_to_h264                  : nvenc
  - ARGB_to_h265                  : nvenc
  - BGR48_to_h264                 : x264
  - BGRA_to_jpega                 : nvjpeg, jpeg
  - BGRA_to_webp                  : webp
  - BGRX_to_h264                  : x264, nvenc
  - BGRX_to_h265                  : nvenc
  - BGRX_to_jpeg                  : nvjpeg, jpeg
  - BGRX_to_webp                  : webp
  - BGR_to_jpeg                   : jpeg
  - BGR_to_webp                   : webp
  - RGBA_to_jpega                 : nvjpeg, jpeg
  - RGBA_to_webp                  : webp
  - RGBX_to_jpeg                  : nvjpeg, jpeg
  - RGBX_to_webp                  : webp
  - RGB_to_jpeg                   : jpeg
  - RGB_to_webp                   : webp
  - XBGR_to_jpeg                  : jpeg
  - XRGB_to_h264                  : nvenc
  - XRGB_to_h265                  : nvenc
  - XRGB_to_jpeg                  : jpeg
  - YUV420P_to_h264               : x264
  - YUV420P_to_jpeg               : jpeg
  - YUV420P_to_vp8                : vpx
  - YUV420P_to_vp9                : vpx
  - YUV422P_to_h264               : x264
  - YUV422P_to_jpeg               : jpeg
  - YUV444P10_to_vp9              : vpx
  - YUV444P_to_h264               : x264
  - YUV444P_to_jpeg               : jpeg
  - YUV444P_to_vp9                : vpx
  - csc-module
    - cython                      : active
    - libyuv                      : active
    - swscale                     : active
  - r210_to_h264                  : nvenc
  - r210_to_h265                  : nvenc
  - video-encoder
    - ffmpeg                      : active
    - gstreamer                   : active
    - jpeg                        : active
    - nvenc                       : active
    - nvjpeg                      : active
    - openh264                    : active
    - vpx                         : active
    - webp                        : active
    - x264                        : active

[Rush-iam]

nvenc h.264 also does not work (despite successful checks) for both 5.0.3 and 6.0 but it is a different story...

[totaam]

I still don't know what OS and version you are running.
But this doesn't look like a package from xpra.org for a start:

* csc_libyuv : No module named 'xpra.codecs.libyuv'
(..)
* dec_spng : No module named 'xpra.codecs.spng'
etc

As for the original question, this is the cause:

* enc_nvjpeg : libnvjpeg.so.12: cannot open shared object file: No such file or directory

The library is missing.

[Rush-iam]

It is Ubuntu 22.04. I install Xpra with --no-install-recommends, which probably excludes some codecs.

The library is missing.

Why does the library work for Xpra 5.0.3 then? The logs above are from the same machine.

[totaam]

I install Xpra with --no-install-recommends

And here we go. You've ended up with a weird installation.

Why does the library work for Xpra 5.0.3 then?

Probably some dependency that was installed then.

[Rush-iam]

I googled it more, it looks like libnvjpeg.so.12 is from CUDA 12, while I have CUDA 11.
So, looks like CUDA 11 support was dropped by Xpra... I guess starting from Xpra 5.0.4.

[totaam]

So, looks like CUDA 11 support was dropped by Xpra...

We have to choose one .so to link against.
By default, we try to always use the current version.