Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce ggml_threadpool #7526

Closed
wants to merge 17 commits into from
Closed

Introduce ggml_threadpool #7526

wants to merge 17 commits into from

Commits on May 24, 2024

  1. Introduce ggml_threadpool 

    Added an API to support explicit management of threadpools.
    fmz committed May 24, 2024
    Configuration menu
    Copy the full SHA
    9a4bdc8 View commit details
    Browse the repository at this point in the history

  2. reset cpu affinity every time for main thread

    @fmz
    fmz committed May 24, 2024
    Configuration menu
    Copy the full SHA
    0ce35a6 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. set bitmask properly on windows

    @fmz
    fmz committed May 25, 2024
    Configuration menu
    Copy the full SHA
    4675838 View commit details
    Browse the repository at this point in the history

  2. roll back CMakePresets.json changes

    @fmz
    fmz committed May 25, 2024
    Configuration menu
    Copy the full SHA
    8bdae21 View commit details
    Browse the repository at this point in the history

  3. free batch threadpool in main

    @fmz
    fmz committed May 25, 2024
    Configuration menu
    Copy the full SHA
    ef1b87d View commit details
    Browse the repository at this point in the history

  4. threadpool: proper handling for non-specified cpumask

    @max-krasnyansky
    max-krasnyansky committed May 25, 2024
    Configuration menu
    Copy the full SHA
    e771674 View commit details
    Browse the repository at this point in the history

  5. threadpool: add persistent threadpool for llama-bench

    @max-krasnyansky
    max-krasnyansky committed May 25, 2024
    Configuration menu
    Copy the full SHA
    c1e7f48 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. threadpool: fix compiler errors for android and x64 builds

    @max-krasnyansky
    max-krasnyansky committed May 28, 2024
    Configuration menu
    Copy the full SHA
    a67dbcc View commit details
    Browse the repository at this point in the history

  2. threadpool: update backend interface in ggml-rpc

    @max-krasnyansky
    max-krasnyansky committed May 28, 2024
    Configuration menu
    Copy the full SHA
    1d9d39a View commit details
    Browse the repository at this point in the history

  3. Restrict threadpool to CPU backend

    fmz committed May 28, 2024
    Configuration menu
    Copy the full SHA
    5c9222d View commit details
    Browse the repository at this point in the history

  4. Restrict threadpool to CPU backend

    fmz committed May 28, 2024
    Configuration menu
    Copy the full SHA
    cbab212 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. llama-bench threadpool CLI params

    @fmz
    fmz committed May 29, 2024
    Configuration menu
    Copy the full SHA
    65c11d4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'threadpool' of https://github.com/CodeLinaro/llama.cpp … 

    …into threadpool
    @fmz
    fmz committed May 29, 2024
    Configuration menu
    Copy the full SHA
    88dc99a View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. fixes for non-llvm builds

    Faisal Zaghloul committed May 30, 2024
    Configuration menu
    Copy the full SHA
    e8c3364 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. fix server test

    Faisal Zaghloul committed May 31, 2024
    Configuration menu
    Copy the full SHA
    719d12b View commit details
    Browse the repository at this point in the history

  2. fix n_threads == 1 bug

    Faisal Zaghloul committed May 31, 2024
    Configuration menu
    Copy the full SHA
    9d6675d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into threadpool

    Faisal Zaghloul committed May 31, 2024
    Configuration menu
    Copy the full SHA
    6a8aa22 View commit details
    Browse the repository at this point in the history