Skip to content

Explore stable diffusion support in Torch-TRT #1545

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Christina-Young-NVIDIA opened this issue Dec 13, 2022 · 2 comments
Closed

Explore stable diffusion support in Torch-TRT #1545

Christina-Young-NVIDIA opened this issue Dec 13, 2022 · 2 comments
Assignees
Labels
examples Sample applications and notebooks on how to use Torch-TensorRT features

Comments

@Christina-Young-NVIDIA
Copy link
Collaborator

Christina-Young-NVIDIA commented Dec 13, 2022

### Tasks
- [ ] https://github.com/pytorch/TensorRT/issues/2144
- [ ] https://github.com/pytorch/TensorRT/issues/2183
- [ ] https://github.com/pytorch/TensorRT/pull/2175
- [ ] https://github.com/pytorch/TensorRT/pull/2182
- [ ] https://github.com/pytorch/TensorRT/pull/2161
- [ ] https://github.com/pytorch/TensorRT/pull/2173
- [ ] https://github.com/pytorch/TensorRT/issues/2124
@ncomly-nvidia ncomly-nvidia added the examples Sample applications and notebooks on how to use Torch-TensorRT features label Dec 13, 2022
@github-actions
Copy link

This issue has not seen activity for 90 days, Remove stale label or comment or this will be closed in 10 days

@gs-olive
Copy link
Collaborator

gs-olive commented Aug 8, 2023

Full Set of Current Missing Operators for Stable Diffusion

##### Other Sub-Architectures
- torch.ops.aten.bmm.default
- torch.ops.aten.linalg_vector_norm.default
- torch.ops.aten.clamp_min.default
- torch.ops.aten.repeat.default
- torch.ops.aten.full.default
- torch.ops.aten.randn.generator

##### UNet
- torch.ops.aten.arange.start_step + Operator Count: 7
- torch.ops.aten.exp.default + Operator Count: 1
- torch.ops.aten._to_copy.default + Operator Count: 7
- torch.ops.aten.sin.default + Operator Count: 1
- torch.ops.aten.cos.default + Operator Count: 1
- torch.ops.aten.native_group_norm.default + Operator Count: 61
- _operator.getitem + Operator Count: 173
- torch.ops.aten.native_layer_norm.default + Operator Count: 48
- torch.ops.aten._scaled_dot_product_efficient_attention.default + Operator Count: 32
- torch.ops.aten.split.Tensor + Operator Count: 16
- torch.ops.aten.clone.default + Operator Count: 16
- torch.ops.aten._unsafe_index.Tensor + Operator Count: 3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
examples Sample applications and notebooks on how to use Torch-TensorRT features
Projects
None yet
Development

No branches or pull requests

7 participants