Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add npu support to big model inference #2222

Merged
merged 7 commits into from
Dec 8, 2023
Merged

Add npu support to big model inference #2222

merged 7 commits into from
Dec 8, 2023

Commits on Dec 8, 2023

  1. Add npu support to big model inference

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    7621202 View commit details
    Browse the repository at this point in the history

  2. make style

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    90c8bf7 View commit details
    Browse the repository at this point in the history

  3. add warning when using npu

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    5c7d2ac View commit details
    Browse the repository at this point in the history

  4. fix typo

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    f39d019 View commit details
    Browse the repository at this point in the history

  5. replace .to(<num>) with .to("npu:<num>") when using torch_npu`

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    430c529 View commit details
    Browse the repository at this point in the history

  6. empty_cache

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    48b6482 View commit details
    Browse the repository at this point in the history

  7. fix

    @statelesshz
    statelesshz committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    b726f27 View commit details
    Browse the repository at this point in the history