Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Intel GPU's #1362

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Add support for Intel GPU's #1362

wants to merge 2 commits into from

Conversation

leuc
Copy link

@leuc leuc commented May 18, 2023

Requires Intel Extension for PyTorch v1.13.120+xpu
Installation Guide: https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html

Successfully tested on Intel ARC A770 16GB VRAM with the large model.

Common issue:
OSError: libmkl_intel_lp64.so.2: cannot open shared object file: No such file or directory

Ensure OneAPI libraries are available in the current shell by running source /opt/intel/oneapi/setvars.sh

Requires Intel Extension for PyTorch v1.13.120+xpu
https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html

Tested on Intel ARC A770 16GB VRAM with large model
@xianlubird
Copy link

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

@leuc
Copy link
Author

leuc commented May 19, 2023

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

No. From the installation guide the verified Hardware Platforms are:

  • Intel® Data Center GPU Flex Series 170
  • Intel® Data Center GPU Max Series
  • Intel® Arc™ A-Series GPUs (Experimental support)

These are all dedicated GPU's, not integrated.

@heligan
Copy link

heligan commented Aug 23, 2023

really appreciate the work. hope it can be merged soon

@leuc
Copy link
Author

leuc commented Sep 22, 2023

seeing some speed-up for time whisper --language en --model large tests/jfk.flac with new intel_extension_for_pytorch

1.13.120+xpu
real 0m23.510s

2.0.110+xpu
real 0m19.706s

intel-i915-dkms 1.23.5.19.230406.21.5.17.0.1034+i38-1 kernel 5.17.0-1020-oem

@cibernox
Copy link

cibernox commented Mar 4, 2024

Has anyone ran this on integrated graphics with ARC architecture (12th and above I believe?)

@hauskens
Copy link

I managed to get this to run on my Intel ARC A770

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants