You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi there!
I'm trying to use Intel NPU and Foundry Local
My NPU has already installed driver successfully.
foundry model run DeepSeek-R1-Distill-Qwen-7B-openvino-npu:1
I tried to run it, but
C:\Users\(hidden)\.foundry>foundry model run DeepSeek-R1-Distill-Qwen-7B-openvino-npu:1
Exception: ❌ Model <DeepSeek-R1-Distill-Qwen-7B-openvino-npu:1> was not found in the catalog or local cache.
🔍 Did you mean: `foundry model run deepseek-r1-distill-qwen-7b-generic-gpu:3`?
👉 Try `foundry model list` to see available models.
👉 Or check for typos in the model name.
[12:37:58 ERR] LogException
Microsoft.AI.Foundry.Local.Common.FLException: ❌ Model <DeepSeek-R1-Distill-Qwen-7B-openvino-npu:1> was not found in the catalog or local cache.
🔍 Did you mean: `foundry model run deepseek-r1-distill-qwen-7b-generic-gpu:3`?
👉 Try `foundry model list` to see available models.
👉 Or check for typos in the model name.
at Microsoft.AI.Foundry.Local.Catalog.AzureFoundryCatalog.<SuggestFuzzyMatch>d__11.MoveNext() + 0xd1c
--- End of stack trace from previous location ---
at Microsoft.AI.Foundry.Local.Common.ModelManagement.<DownloadModelAsync>d__9.MoveNext() + 0x383
--- End of stack trace from previous location ---
at Microsoft.AI.Foundry.Local.Commands.ModelRunCommand.<<Create>b__1_0>d.MoveNext() + 0x5d6
--- End of stack trace from previous location ---
at Microsoft.AI.Foundry.Local.Common.CommandActionFactory.<>c__DisplayClass0_0`1.<<Create>b__0>d.MoveNext() + 0x1e7
--- End of stack trace from previous location ---
at System.CommandLine.NamingConventionBinder.CommandHandler.<GetExitCodeAsync>d__66.MoveNext() + 0x50
--- End of stack trace from previous location ---
at System.CommandLine.NamingConventionBinder.ModelBindingCommandHandler.<InvokeAsync>d__11.MoveNext() + 0x61
--- End of stack trace from previous location ---
at System.CommandLine.Invocation.InvocationPipeline.<InvokeAsync>d__0.MoveNext() + 0x1cd
--- End of stack trace from previous location ---
at Microsoft.AI.Foundry.Local.Program.<Main>d__1.MoveNext() + 0x4e4
C:\Users\(Hidden)\.foundry>
Too bad!
Another problem (maybe the same problem?) is
I tried to show out if I can list out all the NPU-supported models
But
C:\Users\(hidden)\.foundry>foundry model list --filter device=NPU
🕚 Downloading complete!...
Failed to download or register the following EPs: OpenVINOExecutionProvider. Will try installing again later.
Valid EPs: CPUExecutionProvider, WebGpuExecutionProvider
Alias Device Task File Size License Model ID
C:\Users\(Hidden)\.foundry>
The problem is: Failed to download or register the following EPs
I don't know if it's a problem or I did something wrong. So I didn't submit this at issue.
If you know what can I do, comment please. Very THANK YOU!
Environment
CPU = Intel Core Ultra 7 155H
Mem = 32GB
NPU = Intel AI Boost
GPU = Intel Arc Graphics
System = Windows 11 24H2
Region=HongKong,China
I had download an OpenVINO toolkit from Intel and added lib&release&debug folders in it to Path.
My computer supports python.
OpenVINO of Python3.12.8 can detect NPU correctly.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Problems on Intel NPU and Foundry Local
Hi there!
I'm trying to use Intel NPU and Foundry Local
My NPU has already installed driver successfully.
foundry model run DeepSeek-R1-Distill-Qwen-7B-openvino-npu:1I tried to run it, but
Too bad!
Another problem (maybe the same problem?) is
I tried to show out if I can list out all the NPU-supported models
But
The problem is: Failed to download or register the following EPs
I don't know if it's a problem or I did something wrong. So I didn't submit this at issue.
If you know what can I do, comment please. Very THANK YOU!
Environment
CPU = Intel Core Ultra 7 155H
Mem = 32GB
NPU = Intel AI Boost
GPU = Intel Arc Graphics
System = Windows 11 24H2
Region=HongKong,China
I had download an OpenVINO toolkit from Intel and added lib&release&debug folders in it to Path.
My computer supports python.
OpenVINO of Python3.12.8 can detect NPU correctly.
Beta Was this translation helpful? Give feedback.
All reactions