Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: Enable to run Lora - Adapter files are empty #929

Open
kkailaasa opened this issue Nov 23, 2024 · 1 comment
Open

Error: Enable to run Lora - Adapter files are empty #929

kkailaasa opened this issue Nov 23, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@kkailaasa
Copy link

kkailaasa commented Nov 23, 2024

Describe the bug

when trying to run mistral server with a lora repeatedly getting Error: Adapter files are empty. Perhaps the ordering file adapters does not match the actual adapters?

have tried this on different systems and also changing to different file paths and checking - in any permutation combination still getting the same issue

Folder Dir:
Directory structure for: \test_lora

├── config.toml
├── mistralrs-server.exe
├── ordering.json
└── [sample_data_adapter]
    ├── README.md
    ├── adapter_config.json
    ├── adapter_model.safetensors
    ├── special_tokens_map.json
    ├── tokenizer.json
    └── tokenizer_config.json

ordering.json file:

{
    "order": ["sample_data"],
    "layers": {
        "model.layers.0.self_attn.q_proj": 0,
        "model.layers.0.self_attn.k_proj": 1,
        "model.layers.0.self_attn.v_proj": 2,
        "model.layers.0.self_attn.o_proj": 3,
        "model.layers.0.mlp.gate_proj": 4,
        "model.layers.0.mlp.up_proj": 5,
        "model.layers.0.mlp.down_proj": 6
    },
    "base_model_id": "meta-llama/Llama-3.2-1B-Instruct",
    "preload_adapters": [{
        "name": "spiritual_love",
        "adapter_model_id": "sample_data_adapter"
    }]
}

cmds tried:
./mistralrs-server -i lora --model-id meta-llama/Llama-3.2-1B-Instruct --adapters-model-id ./sample_data_adapter --order ./ordering.json

mistralrs-server -i toml -f lora_config.toml (when using toml, only base model ran without the lora)

both for linux and windows, mistralrs-server was built from source

Latest commit or version

running version 0.3.2/git pull as of 22_11_24

@kkailaasa kkailaasa added the bug Something isn't working label Nov 23, 2024
@kkailaasa kkailaasa changed the title Error: Adapter files are empty Error: Adapter files are empty when trying to run with Lora Nov 23, 2024
@kkailaasa kkailaasa changed the title Error: Adapter files are empty when trying to run with Lora Error: Enable to run Lora - Adapter files are empty Nov 28, 2024
@kkailaasa
Copy link
Author

Hello again, just reverting back on this - if anyone could check and help me out - Please and thank you..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant