Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[VLM] Remove image_input_type from VLM config #5852

Merged
merged 23 commits into from
Jul 2, 2024
Merged

[VLM] Remove image_input_type from VLM config #5852

merged 23 commits into from
Jul 2, 2024

Commits on Jun 26, 2024

  1. [VLM] Remove support for pixel_values and image_features. 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    4f7b210 View commit details
    Browse the repository at this point in the history

  2. address comments 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    174ca90 View commit details
    Browse the repository at this point in the history

  3. remove image_input_type altogether. 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    5b3e9aa View commit details
    Browse the repository at this point in the history

  4. types 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    b7acf3a View commit details
    Browse the repository at this point in the history

  5. format 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    f22b219 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Merge branch 'main' of https://github.com/vllm-project/vllm into remo… 

    …ve_image_features_2
    @xwjiang2010
    xwjiang2010 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    91d6c1e View commit details
    Browse the repository at this point in the history

  2. format 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    f84b793 View commit details
    Browse the repository at this point in the history

  3. ExternalMultiModalDataDict 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    a934663 View commit details
    Browse the repository at this point in the history

  4. mention schema

    @xwjiang2010
    xwjiang2010 authored Jun 28, 2024
    Configuration menu
    Copy the full SHA
    2144d3a View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. address comments 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    d432934 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/vllm-project/vllm into remo… 

    …ve_image_features_2
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    83cfada View commit details
    Browse the repository at this point in the history

  3. format 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    ab347bc View commit details
    Browse the repository at this point in the history

  4. rm ctx 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    404700f View commit details
    Browse the repository at this point in the history

  5. rm ImageData and MultiModalData 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    04ebb68 View commit details
    Browse the repository at this point in the history

  6. rm external 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    31b8b09 View commit details
    Browse the repository at this point in the history

  7. comments 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    a4b5617 View commit details
    Browse the repository at this point in the history

  8. fix dist gpu test. 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    045674d View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. address comments

    @xwjiang2010
    xwjiang2010 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    c8fa150 View commit details
    Browse the repository at this point in the history

  2. docs 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b1f1813 View commit details
    Browse the repository at this point in the history

  3. Update vllm/multimodal/base.py 

    Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
    @xwjiang2010 @DarkLight1337
    xwjiang2010 and DarkLight1337 authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b8b636d View commit details
    Browse the repository at this point in the history

  4. format 

    Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
    @xwjiang2010
    xwjiang2010 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    2c1d291 View commit details
    Browse the repository at this point in the history

  5. fix import error

    @ywang96
    ywang96 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    4278fed View commit details
    Browse the repository at this point in the history

  6. update llava next example

    @ywang96
    ywang96 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    d9a2908 View commit details
    Browse the repository at this point in the history