v5.1.0

[HolyWu]

• Add num_batches parameter.
• Add AnimeJaNai_HD_V3Sharp1 and AnimeJaNai_SD_V1beta34 models from https://github.com/the-database/mpv-upscale-2x_animejanai.
• Switch to dynamo IR for compilation in TorchTRT. A few parameters are added and INT8 quantization is removed.
• Improve performance by using separate streams and non_blocking for moving tensors between CPU and GPU. Now num_streams arg has negligible influence on performance compared to num_batches arg.
• Bump PyTorch to 2.6.0.dev.
• Bump Torch-TensorRT to 2.6.0.dev.

---

This discussion was created from the release v5.1.0.