Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Frontend][Core] Move guided decoding params into sampling params #8252

Merged
merged 39 commits into from
Oct 1, 2024
Merged

[Frontend][Core] Move guided decoding params into sampling params #8252

merged 39 commits into from
Oct 1, 2024

Commits on Sep 6, 2024

  1. ♻️ refactor guided decoding construction 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    2673021 View commit details
    Browse the repository at this point in the history

  2. ♻️ refactor to_sampling_params 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    382a240 View commit details
    Browse the repository at this point in the history

  3. ♻️ update sampling params in openai servers 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    ff6c147 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. ⚡ build LPs in engine / client 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    ab0fea0 View commit details
    Browse the repository at this point in the history

  2. ♻️ move test file 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    41a18d5 View commit details
    Browse the repository at this point in the history

  3. ✅ fixup tests 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    40260eb View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. 🗑️ deprecate GuidedDecodingRequest usage 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9d3b185 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    610423e View commit details
    Browse the repository at this point in the history

  3. 🥅 disallow both guided options 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9b6ab55 View commit details
    Browse the repository at this point in the history

  4. 🐛 fixup LLM tests 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    429704d View commit details
    Browse the repository at this point in the history

  5. 🎨 fmt 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2df4783 View commit details
    Browse the repository at this point in the history

  6. 🎨 more fmt 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    97a1116 View commit details
    Browse the repository at this point in the history

  7. ⚡ ensure use of async outlines LP construction 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    24d95fe View commit details
    Browse the repository at this point in the history

  8. ♻️ move guided params construction 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    0fa5080 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    2920459 View commit details
    Browse the repository at this point in the history

  2. 🎨 fmt 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    450c76e View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    6bfa8a8 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    07a17ef View commit details
    Browse the repository at this point in the history

  2. ♻️ refactor mistral unsupported errors 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    d4540ca View commit details
    Browse the repository at this point in the history

  3. ✅ test guided decoding validation 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1d580d2 View commit details
    Browse the repository at this point in the history

  4. 🎨 fmt 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b984187 View commit details
    Browse the repository at this point in the history

  5. 🐛 fixup engine client test 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1c2bbf1 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. 🐛 start to fixup for msgspec 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    aa84827 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    c52075b View commit details
    Browse the repository at this point in the history

  3. ⚡ add LP construction to mqllmengine client 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    891c526 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    2b59d03 View commit details
    Browse the repository at this point in the history

  2. 🎨 fmt 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    8f079e5 View commit details
    Browse the repository at this point in the history

  3. ♻️ extract BaseModel schema up-front 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    ed29ec2 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    bea1716 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    74e9187 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    7b17aba View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    76182e4 View commit details
    Browse the repository at this point in the history

  2. ♻️ v -> s 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    6281044 View commit details
    Browse the repository at this point in the history

  3. Update vllm/engine/async_llm_engine.py 

    Co-authored-by: Nick Hill <nickhill@us.ibm.com>
    @joerunde @njhill
    joerunde and njhill authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    a4e2523 View commit details
    Browse the repository at this point in the history

  4. Update vllm/engine/llm_engine.py 

    Co-authored-by: Nick Hill <nickhill@us.ibm.com>
    @joerunde @njhill
    joerunde and njhill authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    8acc98e View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Revert "Update vllm/engine/async_llm_engine.py" 

    This reverts commit a4e2523.
    @joerunde
    joerunde committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    485ce1d View commit details
    Browse the repository at this point in the history

  2. ♻️ refactor guided decoding lp construction 

    Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
    @joerunde
    joerunde committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    f0a3f9d View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main' into lp-scratch

    @joerunde
    joerunde committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    ec92fd5 View commit details
    Browse the repository at this point in the history

  4. retrigger CI

    @joerunde
    joerunde committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    5385175 View commit details
    Browse the repository at this point in the history