Skip to content

1.0.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@helloxz helloxz released this 12 Mar 06:16
· 2 commits to main since this release

Support load balancing for multiple large model interfaces
Provide a unified API interface
Compatible with OpenAI
Support streaming transmission
Support IP affinity algorithm