Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update neuron backend #2314

Merged
merged 5 commits into from
Sep 18, 2024
Merged

Update neuron backend #2314

merged 5 commits into from
Sep 18, 2024

Commits on Sep 17, 2024

  1. feat(neuron): align with latest optimum-neuron

    @dacorvo
    dacorvo committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    ec2e13a View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. feat(neuron): support pre-exported neuron models

    @dacorvo
    dacorvo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    c0afda5 View commit details
    Browse the repository at this point in the history

  2. fix(neuron): correctly use max_length

    @dacorvo
    dacorvo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7ff9015 View commit details
    Browse the repository at this point in the history

  3. fix(neuron): adapt loglikelihood 

    The evaluation of log likelihood was not working for neuron models
using continuous batching, such as all cached neuron LLama models.
    @dacorvo
    dacorvo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    69bb95b View commit details
    Browse the repository at this point in the history

  4. refactor(neuron): remove dead code

    @dacorvo
    dacorvo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    54c55ca View commit details
    Browse the repository at this point in the history