Skip to content

[Benchmark][0.7.3] Add qwen2.5 and qwen2.5-vl to benchmarks #792

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
May 19, 2025
Merged

[Benchmark][0.7.3] Add qwen2.5 and qwen2.5-vl to benchmarks #792

merged 6 commits into from
May 19, 2025

Conversation

@Potabk
Copy link
Collaborator

@Potabk Potabk commented May 8, 2025 •
edited
Loading

What this PR does / why we need it?

  • Optimized the benchmark script
  • Add convert json to markdown script for the benchmark results
  • Add qwen2.5 and qwen2.5-vl to the test list
  • Optimized benchmark readme
  • cherry-pick benchmark developer-guide from main

Does this PR introduce any user-facing change?

How was this patch tested?

@github-actions github-actions bot added the documentation Improvements or additions to documentation label May 8, 2025
@wangxiyuan
Copy link
Collaborator

wangxiyuan commented May 10, 2025

do we still need PR for 073 branch?

@wangxiyuan
Copy link
Collaborator

wangxiyuan commented May 12, 2025

Need cherry-pick benchmark doc to 073 as well

Potabk added 4 commits May 19, 2025 09:57
@Potabk
add qwen series test
1b4a51d 
Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
fix format
fe91768 
Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
fix readme
aa53229 
Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
cherry-pick developer_guide from main
be7488d 
Signed-off-by: wangli <wangli858794774@gmail.com>
Potabk added 2 commits May 19, 2025 10:20
@Potabk
fix shell check
99196ad 
Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
fix doc check
64cf976 
Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
Copy link
Collaborator Author

Potabk commented May 19, 2025

Need cherry-pick benchmark doc to 073 as well

done

@Potabk
Copy link
Collaborator Author

Potabk commented May 19, 2025

@wangxiyuan This commit is ready for review

@wangxiyuan wangxiyuan changed the title [Benchmark] Add qwen2.5 and qwen2.5-vl to benchmarks [Benchmark][0.7.3] Add qwen2.5 and qwen2.5-vl to benchmarks May 19, 2025
@wangxiyuan wangxiyuan merged commit 49754f8 into vllm-project:v0.7.3-dev May 19, 2025
10 checks passed
@Potabk Potabk deleted the bench branch May 19, 2025 08:18
@wangxiyuan wangxiyuan mentioned this pull request May 21, 2025
Closed
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@wangxiyuan wangxiyuan wangxiyuan approved these changes

Assignees

No one assigned

Labels

documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Potabk @wangxiyuan