Skip to content

feat(transformer): transformer-based backend #1015

Closed
@mudler

Description

@mudler

Is your feature request related to a problem? Please describe.
It makes sense to have a backend which is tied to https://github.com/huggingface/transformers. This would increase the range of support for LLM that LocalAI already offers

Describe the solution you'd like
Ideally would be preferred to use a wrapper around transformers and xformers to avoid duplicating efforts.

Describe alternatives you've considered

Additional context

Metadata

Metadata

Assignees

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions