Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: Support Ctransformers #289

Merged
merged 61 commits into from
Aug 11, 2023
Merged

FEAT: Support Ctransformers #289

merged 61 commits into from
Aug 11, 2023

Conversation

RayJi01
Copy link
Contributor

@RayJi01 RayJi01 commented Aug 3, 2023 •
edited by UranusSeven
Loading

Resolves #220

@XprobeBot XprobeBot added this to the v0.1.1 milestone Aug 3, 2023
@RayJi01 RayJi01 marked this pull request as draft August 3, 2023 06:38
@RayJi01 RayJi01 marked this pull request as ready for review August 4, 2023 08:43
@RayJi01 RayJi01 changed the title FEAT: Support Ctransformer. FEAT: Support Ctransformer Aug 4, 2023
@XprobeBot XprobeBot modified the milestones: v0.1.1, v0.2.0 Aug 5, 2023
@RayJi01 RayJi01 linked an issue Aug 7, 2023 that may be closed by this pull request
FEAT: support starcoder #184
Closed
RayJi01
RayJi01 commented Aug 7, 2023
View reviewed changes
setup.cfg Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformer.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformer.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformer.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformer.py Outdated Show resolved Hide resolved
UranusSeven
UranusSeven reviewed Aug 9, 2023
View reviewed changes
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
UranusSeven
UranusSeven reviewed Aug 10, 2023
View reviewed changes
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/llm_family.json Outdated Show resolved Hide resolved
UranusSeven
UranusSeven reviewed Aug 11, 2023
View reviewed changes
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/ctransformers_util.py Outdated Show resolved Hide resolved
xinference/model/llm/ggml/tests/test_ctransformers.py Outdated Show resolved Hide resolved
@RayJi01 RayJi01 changed the title FEAT: Support Ctransformer FEAT: Support Ctransformers Aug 11, 2023
@UranusSeven UranusSeven merged commit 240e218 into xorbitsai:main Aug 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@UranusSeven UranusSeven UranusSeven approved these changes

Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
v0.2.0
Development

Successfully merging this pull request may close these issues.

ENH: incorporate ctransformer FEAT: support starcoder
3 participants
@RayJi01 @UranusSeven @XprobeBot