Skip to content

v5.1.0

Latest
Compare
Choose a tag to compare
@HolyWu HolyWu released this 20 Oct 15:10
· 8 commits to master since this release
  • Add num_batches parameter.
  • Add AnimeJaNai_HD_V3Sharp1 and AnimeJaNai_SD_V1beta34 models from https://github.com/the-database/mpv-upscale-2x_animejanai.
  • Switch to dynamo IR for compilation in TorchTRT. A few parameters are added and INT8 quantization is removed.
  • Improve performance by using separate streams and non_blocking for moving tensors between CPU and GPU. Now num_streams arg has negligible influence on performance compared to num_batches arg.
  • Bump PyTorch to 2.6.0.dev.
  • Bump Torch-TensorRT to 2.6.0.dev.