Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Add support for Intel Ultra NPUs (AI Boost) #115

Open
1 task done
guillaume-rce opened this issue Jul 8, 2024 · 2 comments
Open
1 task done
Labels
enhancement New feature or request

Comments

@guillaume-rce
Copy link

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

It would be interesting if NPUs from the new Intel Ultra processor range were added to the list of available devices.
When I tested the OpenVINO toolkit, I saw that it was already supported, so why not add it to Stable diffusion Web UI?

Proposed workflow

Simply add the NPU to the device list

Additional information

No response

@guillaume-rce guillaume-rce added the enhancement New feature or request label Jul 8, 2024
@ustas-eth
Copy link

Do you think it'll work without any additional tweaks other than adding the device to the list?

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

It seems like they just get the list from your system. If you don't see NPU by using the command above, I guess you lack the drivers.

openvino_device = gr.Dropdown(label="Select a device", choices=list(core.available_devices), value=model_state.device)

I can't check it myself because I'm on OpenSUSE, and I don't know if there's a way to install drivers on OSs other than Ubuntu.

@iamPorter
Copy link

iamPorter commented Aug 21, 2024

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

I saw "NPU" after running the command you mentioned, but "NPU" does not appear in SD Web UI.

p.s. Tested on Windows 11 with Intel Ultra 9 185H.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants