Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Architecture "LlavaMistralForCausalLM" not supported! #8533

Closed
4 tasks done
dafei2017 opened this issue Jul 17, 2024 · 4 comments
Closed
4 tasks done
Labels
enhancement New feature or request stale

Comments

@dafei2017
Copy link

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Because the model is divided into four parts in https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b/tree/main, the above problems in the process of merging model, how to solve this problem, please?

Motivation

python .\convert-hf-to-gguf.py .\llava-med-v1.5-mistral-7b\ --outfile .\llava-med\ Loading model: llava-med-v1.5-mistral-7b Traceback (most recent call last): File "E:\gyf\offline-model\AR-agent\llama.cpp\convert-hf-to-gguf.py", line 1876, in main() File "E:\gyf\offline-model\AR-agent\llama.cpp\convert-hf-to-gguf.py", line 1857, in main model_instance = model_class(dir_model, ftype_map[args.outtype], fname_out, args.bigendian) File "E:\gyf\offline-model\AR-agent\llama.cpp\convert-hf-to-gguf.py", line 50, in init self.model_arch = self._get_model_architecture() File "E:\gyf\offline-model\AR-agent\llama.cpp\convert-hf-to-gguf.py", line 281, in _get_model_architecture raise NotImplementedError(f'Architecture "{arch}" not supported!') NotImplementedError: Architecture "LlavaMistralForCausalLM" not supported!

Possible Implementation

No response

@dafei2017 dafei2017 added the enhancement New feature or request label Jul 17, 2024
@ccslience
Copy link

I met the same issue

@github-actions github-actions bot added the stale label Aug 17, 2024
Copy link
Contributor

This issue was closed because it has been inactive for 14 days since being marked as stale.

@ccslience
Copy link

ccslience commented Aug 31, 2024 via email

@drzraf
Copy link

drzraf commented Sep 1, 2024

Sounds like a valid issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request stale
Projects
None yet
Development

No branches or pull requests

3 participants