Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Support serving encoder/decoder models #7258

Merged
merged 35 commits into from
Aug 9, 2024
Merged

[Core] Support serving encoder/decoder models #7258

merged 35 commits into from
Aug 9, 2024

Commits on Aug 7, 2024

  1. Introduce is_list_of

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    33c9e25 View commit details
    Browse the repository at this point in the history

  2. Avoid circular imports

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    e6dd6f5 View commit details
    Browse the repository at this point in the history

  3. Refactor prompt parsing and extend this to async engine

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    f938c86 View commit details
    Browse the repository at this point in the history

  4. Remove unnecessary comments

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    6332d1e View commit details
    Browse the repository at this point in the history

  5. Enable full async

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    07b4d21 View commit details
    Browse the repository at this point in the history

  6. grammar

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    e29864c View commit details
    Browse the repository at this point in the history

  7. Add description

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    c9dfb40 View commit details
    Browse the repository at this point in the history

  8. Fix wrong type annotations

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    1233192 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'upstream' into inputs-parser

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    f332275 View commit details
    Browse the repository at this point in the history

  10. Remove redundant docs

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    dcdebee View commit details
    Browse the repository at this point in the history

  11. Be more strict

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    65db3f1 View commit details
    Browse the repository at this point in the history

  12. Fix docs

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    9ffeb22 View commit details
    Browse the repository at this point in the history

  13. Fix 2

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    c9e0b08 View commit details
    Browse the repository at this point in the history

  14. Disallow multi-modal data for enc/dec models

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    14bca1f View commit details
    Browse the repository at this point in the history

  15. Improve type narrowing behavior using TypeIs

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8fc7099 View commit details
    Browse the repository at this point in the history

  16. Avoid sequential await

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    3a8a072 View commit details
    Browse the repository at this point in the history

  17. Fix type annotations based on test files

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    ef5327c View commit details
    Browse the repository at this point in the history

  18. Properly handle inputs["decoder_prompt"]=None

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8a835cc View commit details
    Browse the repository at this point in the history

  19. Clean

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    e0024c2 View commit details
    Browse the repository at this point in the history

  20. Clean

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    76af172 View commit details
    Browse the repository at this point in the history

  21. Fix incorrect decoder inputs in singleton case

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    5c16f2e View commit details
    Browse the repository at this point in the history

  22. Clean

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    e239ba9 View commit details
    Browse the repository at this point in the history

  23. Move functions to a more appropriate place

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    4b0e3df View commit details
    Browse the repository at this point in the history

  24. Remove outdated comment

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    53f7f50 View commit details
    Browse the repository at this point in the history

  25. Fix mismatch between hf and vllm output text

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    3afdbc5 View commit details
    Browse the repository at this point in the history

  26. Factor out duplicate code

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    c61b01f View commit details
    Browse the repository at this point in the history

  27. Factor out more duplicate code

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    f8ed373 View commit details
    Browse the repository at this point in the history

  28. Remove default values to avoid accidentally miss those arguments

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a4df70a View commit details
    Browse the repository at this point in the history

  29. Add test for serving encoder/decoder model with OpenAI server

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    5240bb3 View commit details
    Browse the repository at this point in the history

  30. Use two type variables

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    d321c82 View commit details
    Browse the repository at this point in the history

  31. Merge branch 'upstream' into inputs-parser

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    931d1f6 View commit details
    Browse the repository at this point in the history

  32. Merge branch 'upstream' into inputs-parser

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a06c67f View commit details
    Browse the repository at this point in the history

  33. Merge branch 'upstream' into inputs-parser

    @DarkLight1337
    DarkLight1337 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    9f64a05 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Update error message

    @DarkLight1337
    DarkLight1337 committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    e4c5c21 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into inputs-parser

    @DarkLight1337
    DarkLight1337 committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    68fbf5a View commit details
    Browse the repository at this point in the history