Future OpenVINO, Vulkan, OpenCL and OpenGL support for accessibility of hardware? #16651
avachon100510
started this conversation in
Optimization
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Many devices are left behind, as we can notice. Older generations of GPUs have very insufficient VRAM to properly handle Stable Diffusion without crashing or running out of VRAM. Especially on the ASUS VivoBook X512D laptop I am using, which has an AMD Ryzen 3500U @ 2.10 GHz with a Radeon(TM) Vega 8 Graphics Mobile GPU at 2048 MB VRAM. Not to mention that CPU generation is painfully slow. Including support for low-end devices would help people save money that would be spent on expensive high-end hardware.
Some of the ways we can do that would go from using OpenCL, a neat alternative that hasn't been standardized yet for Stable Diffusion but which use both the CPU and GPU.
Another is through Vulkan.
OpenVINO is another possibility: it works on AMD and Intel CPUs, but more importantly on Intel GPUs. Although there is no official support for AMD GPUs, some people have indeed reported success using it on AMD GPUs.
I hope some of these improvements could be made in the future, as these would help people handle hardware bottlenecks better.
Beta Was this translation helpful? Give feedback.
All reactions