Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] Support SigLIP encoder and alternative decoders for LLaVA models #7153

Merged
merged 19 commits into from
Aug 6, 2024
Merged

[Model] Support SigLIP encoder and alternative decoders for LLaVA models #7153

merged 19 commits into from
Aug 6, 2024

Commits on Aug 5, 2024

  1. Loosen the image size requirement

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    2cb30fb View commit details
    Browse the repository at this point in the history

  2. Enable dynamic LLM backbone and SigLIP for LLAvA

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    9ecf7f4 View commit details
    Browse the repository at this point in the history

  3. format

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ca2cc07 View commit details
    Browse the repository at this point in the history

  4. Move code

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    0cfdc9b View commit details
    Browse the repository at this point in the history

  5. Add comments

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ababd45 View commit details
    Browse the repository at this point in the history

  6. Factor out common code for setting up inner model

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    139b8b8 View commit details
    Browse the repository at this point in the history

  7. Enable dynamic LLM backbone and SigLIP for LLaVA-NeXT

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    6316395 View commit details
    Browse the repository at this point in the history

  8. Fix feature size calculation for "default" strategy 

    Fix off-by-one error
    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    0a2eb73 View commit details
    Browse the repository at this point in the history

  9. Call get_model_architecture

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    a62ff07 View commit details
    Browse the repository at this point in the history

  10. format

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    66eeb9a View commit details
    Browse the repository at this point in the history

  11. Move inner model loading code

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    3736db7 View commit details
    Browse the repository at this point in the history

  12. Update docs

    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    0eef288 View commit details
    Browse the repository at this point in the history

  13. Auto-detect image ID to be robust against switching test models; add … 

    …test code for Mantis model
    @DarkLight1337
    DarkLight1337 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    7c45a52 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Comment out unused dependency

    @DarkLight1337
    DarkLight1337 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d012496 View commit details
    Browse the repository at this point in the history

  2. Add comment

    @DarkLight1337
    DarkLight1337 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    7d2cb1c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into llava-siglip

    @ywang96
    ywang96 authored Aug 6, 2024
    Configuration menu
    Copy the full SHA
    1c32422 View commit details
    Browse the repository at this point in the history

  4. Rename

    @DarkLight1337
    DarkLight1337 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    cf22bc4 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'upstream' into llava-siglip

    @DarkLight1337
    DarkLight1337 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    153cc16 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'llava-siglip' of github.com:DarkLight1337/vllm-rocm int… 

    …o llava-siglip
    @DarkLight1337
    DarkLight1337 committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    5a9c179 View commit details
    Browse the repository at this point in the history