Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please add xinference, which is a very comprehensive and powerful open source project #780

Open
ZimaBlueee opened this issue Jun 27, 2024 · 0 comments

Comments

@ZimaBlueee
Copy link

Is your feature request related to a problem? Please describe.
I have a llm deployed locally and cannot use OpenAI.

Describe the solution you'd like
I would like to access the open source project: xinference. Xinference gives you the freedom to use any LLM you need. It is much more powerful than ollama! Address: https://github.com/xorbitsai/inference.

Describe alternatives you've considered
Ollama is also possible, but not recommended because it supports too few models

Additional context
For projects involving company knowledge bases, everyone hopes that the data will not be leaked, so it is necessary to use local LLM.

Thank you for your project, it's amazing, I hope you can consider this demand!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant