Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: Support Mixtral-8x7B-v0.1 models #782

Merged
merged 12 commits into from
Dec 22, 2023

Conversation

Bojun-Feng
Copy link
Contributor

Fix #751

  • Update Model Family JSON
  • Update README
  • Update Docs

Unfortunately, my laptop is too small to run the model locally. That being said, this does look like a really interesting model when I looked it up. I would recommend people who are interested in the details of this model to check out this blog post by the Mistral team.

@XprobeBot XprobeBot added this to the v0.7.3 milestone Dec 18, 2023
@ChengjieLi28 ChengjieLi28 changed the title FEAT: Support Mistral-8x7B-Instruct-v0.1 FEAT: Support Mixtral-8x7B-v0.1 models Dec 19, 2023
@ChengjieLi28
Copy link
Contributor

@Bojun-Feng . I will take over this PR now. Thanks for your contribution for Mixtral chat model supports.

@ChengjieLi28 ChengjieLi28 force-pushed the feat/Mistral-8x7B-Instruct_v0.1 branch from d1cbb5b to fedb5a0 Compare December 21, 2023 09:27
@aresnow1 aresnow1 merged commit e077926 into xorbitsai:main Dec 22, 2023
10 of 12 checks passed
Bojun-Feng added a commit to Bojun-Feng/inference that referenced this pull request Dec 27, 2023
Co-authored-by: ChengjieLi <chengjieli23@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Request for Support for Mistralai/Mixtral-8x7B-Instruct-v0.1 LLM
4 participants