Skip to content

Conversation

@zhangxinyuehfad
Copy link
Contributor

@zhangxinyuehfad zhangxinyuehfad commented May 8, 2025

What this PR does / why we need it?

Add accuracy report for v0.7.3 release
Models and datasets for accuracy test:

Model datasets
Qwen2.5-7B-Instruct ceval-val, gsm8k, mmlu
Llama-3.1-8B-Instruct ceval-val, gsm8k, mmlu
Qwen2.5-VL-7B-Instruct mmmu_val

Does this PR introduce any user-facing change?

This PR will display the accuracy test report of the v0.7.3 version in docs/source/developer_guide/accuracy_report。
Qwen2.5-7B-Instruct.md
Llama-3.1-8B-Instruct.md
Qwen2.5-VL-7B-Instruct .md

@github-actions github-actions bot added the documentation Improvements or additions to documentation label May 8, 2025
@zhangxinyuehfad zhangxinyuehfad changed the title Add accuracy report for V0.7.3 [Doc] Add accuracy report for V0.7.3 May 8, 2025
@zhangxinyuehfad zhangxinyuehfad changed the title [Doc] Add accuracy report for V0.7.3 [v0.7.3][Doc] Add accuracy report for V0.7.3 May 8, 2025
@zhangxinyuehfad zhangxinyuehfad changed the title [v0.7.3][Doc] Add accuracy report for V0.7.3 [v0.7.3][Doc] Add accuracy report May 8, 2025
@zhangxinyuehfad zhangxinyuehfad force-pushed the zxy_accuracy branch 11 times, most recently from f8dc941 to 8b6e9da Compare May 8, 2025 11:05
Signed-off-by: hfadzxy <starmoon_zhang@163.com>
@Yikun Yikun merged commit e29e39a into vllm-project:v0.7.3-dev May 8, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants