Skip to content

[Doc]: add Optimization and Tuning for main #1387

@Yikun

Description

@Yikun

📚 The doc issue

1. Compilation Optimization
1.1 Install optimized python

2. OS Optimization

3. torch_npu Optimization

4. CANN Optimization
4.1 HCCL Optimization (include AIV)

Suggest a potential alternative/fix

referenc https://vllm-ascend.readthedocs.io/en/v0.7.3.post1/developer_guide/performance/optimization_and_tuning.html#benchmark

Metadata

Metadata

Assignees

Labels

documentationImprovements or additions to documentation

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions