Add NVENC AV1 FFmpeg encoder

[Bleuzen]

Description

Adds NVENC AV1 support to obs-ffmpeg

Motivation and Context

Linux users can use NVENC only for H264 and HEVC currently. However current gen GPUs do support encoding AV1, which should be exposed as an option in OBS.

How Has This Been Tested?

Tested recording in mp4 and mkv so far on a Linux system with Nvidia RTX40xx GPU.

TODO

• Testing (general functionality / performance / different bitrate & quality settings...)
• The detection of AV1 support is not optimal - only ffmpeg is checked if it offers the av1_nvenc encoder but afaik this does not guarantee that the GPU really supports it

Types of changes

• New feature (non-breaking change which adds functionality)

Checklist:

• My code has been run through clang-format.
• I have read the contributing document.
• My code is not on the master branch.
• The code has been tested.
• All commit messages are properly formatted and commits squashed where appropriate.
• I have included updates to all appropriate documentation.

[norihiro]

The first word for each commit title should be capitalized, for example, like below. However, I think all commits should be squashed into one commit rather than making a 'fix' commit.

- obs-ffmpeg: fix nvenc av1 encoder name
+ obs-ffmpeg: Fix nvenc av1 encoder name

[Bleuzen]

@norihiro Thanks for the hint. Commits are now squashed, rebased on latest master and commit message is corrected.

[Bleuzen]

Just tested with the "obs_extract_av1_headers" function from this PR:
#8832
it fixes the first seconds of the video being corrupted & mkv recording

[M-Ro]

av1 = nvenc_codec_exists("av1_nvenc", NULL);

This seems to return false for me, which is a bit strange on a 4080. I've definitely got AV1 NVenc working as I currently use it without issue through ffmpeg 6. Any ideas on what I might be missing?

libnvidia-encode.so.1 points to libnvidia-encode.so.535.98 which are the most recent drivers.

Edit: Nevermind, I'm probably compiling against a stale version of libavcodec.

[ryzendew]

i have tested this on Arch linux and it worked so well thank you for your hardwork

[ryzendew]

one issue when using MKV the video is blank but mp4 works

[Bleuzen]

@ryzendew

one issue when using MKV the video is blank but mp4 works

Known issue, as I wrote in the initial post. This is because OBS currently lacks a function to extract av1 headers. However there is another PR adding it. You need to merge this too:
#9475
And add the call to the obs_extract_av1_headers function here:
https://github.com/obsproject/obs-studio/pull/8794/files#diff-fc007c567208a25eac997f8ad710956b8be02bbc3f95b401719c971830ca42ebR293

[ryzendew]

@ryzendew

one issue when using MKV the video is blank but mp4 works

Known issue, as I wrote in the initial post. This is because OBS currently lacks a function to extract av1 headers. However there is another PR adding it. You need to merge this too: #9475 And add the call to the obs_extract_av1_headers function here: https://github.com/obsproject/obs-studio/pull/8794/files#diff-fc007c567208a25eac997f8ad710956b8be02bbc3f95b401719c971830ca42ebR293

thank you i hope they merge your work soon AV1 is a god send!

[Bleuzen]

when using MKV the video is blank

should be fixed now with latest commit (at least in my testing)

[ryzendew]

when using MKV the video is blank

should be fixed now with latest commit (at least in my testing)

Yes the MKV issues is solved i just did a 3 hour recording without any issues thank you for such hard work i can now record on linux again!

[ANISANi]

Cool all work with
GPU: 4070-max q.
OS: Arch linux.
Tested Bitrate: CBR 6000 Kbps, CQP: CQ level 20-50. (at 20 - bitrate up to 150 000 Kbps, at 50 - 41 000 Kbps).
Driver: 535.43.16 with open-dkms.
using mkv.

[ghost]

Any news if this will get merged ?

[ryzendew]

sometimes the Video still goes blank and it's random

13:13:49.024: ==== Recording Start =============================================== 13:13:49.025: [ffmpeg muxer: 'adv_file_output'] Writing file '/home/matt/2023-12-26 13-13-48.mkv'... 13:13:49.226: [FFmpeg NVENC encoder: 'advanced_video_recording'] Applying DTS value corrections 13:13:53.137: [ffmpeg muxer: 'adv_file_output'] Output of file '/home/matt/2023-12-26 13-13-48.mkv' stopped 13:13:53.137: Output 'adv_file_output': stopping 13:13:53.137: Output 'adv_file_output': Total frames output: 234 13:13:53.137: Output 'adv_file_output': Total drawn frames: 244 (247 attempted) 13:13:53.137: Output 'adv_file_output': Number of lagged frames due to rendering lag/stalls: 3 (1.2%)

[ryzendew]

Going to test the newest changes now

[ryzendew]

VLC is trash! mpv shows the video is working!

[derrod]

Likely to be superseeded by #10122 which adds support for the native NVENC encoder on Linux (only without texture sharing for now).

[ryzendew]

I tried the other 2 AV1 Pr's and both failed to work

with the same error and i would post on the PR's but i can't yet the PR asked for testers
obs.log

This is the only PR that works for AV1 on my 4070