Skip to content

hardware: Windows on ARM support (with Snapdragon X series NPU) #928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 task done
high3eam opened this issue Jul 18, 2024 · 1 comment
Open
1 task done

hardware: Windows on ARM support (with Snapdragon X series NPU) #928

high3eam opened this issue Jul 18, 2024 · 1 comment
Labels
category: hardware management Related to hardware & compute type: feature request A new feature

Comments

@high3eam
Copy link

  • I have searched the existing issues

Is your feature request related to a problem? Please describe it

I was wondering if jan supports Windows on ARM platform, specifically on Snapdragon X series chips. Is it already planned to support this platform and potentially allow the use of the integrated NPU?
It looks like closed source competitor "LMStudio" supports the platform already (BETA, and still without NPU support).

Describe the solution

Support for Windows on ARM and integrated NPU of Snapdragon X series chips.

Teachability, documentation, adoption, migration strategy

No response

What is the motivation / use case for changing the behavior?

Since Windows on ARM laptop are taking of with the newly released qualcomm ARM chips, it would be great if Jan natively supported it.

@high3eam high3eam added the type: feature request A new feature label Jul 18, 2024
@Van-QA Van-QA transferred this issue from menloresearch/jan Jul 28, 2024
@imtuyethan imtuyethan moved this from Planned to Icebox in Menlo Aug 28, 2024
@freelerobot freelerobot added the category: hardware management Related to hardware & compute label Sep 6, 2024
@freelerobot
Copy link
Contributor

We're working on supporting ONNX format models through DirectML, which natively accelerates on NPUs. There are some models available already, but consider this a work in progress https://cortex.so/models/

@dan-menlo dan-menlo changed the title feat: Windows on ARM support (with Snapdragon X series NPU) hardware: Windows on ARM support (with Snapdragon X series NPU) Sep 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: hardware management Related to hardware & compute type: feature request A new feature
Projects
Status: Icebox
Development

No branches or pull requests

3 participants