[Feature]: Add Enable EPLB condition #20669
Description
🚀 The feature, motivation and pitch
Current enable eplb after only check current platform wether is cuda, if current platform only a one cuda device, should eplb be disabled or given a warning?
only one cuda device, ep is no't need load blancing.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.