feat: add apple silicon GPU acceleration #1217
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
younesbelkada
approved these changes
Dec 5, 2023
There was a problem hiding this comment.
LGTM - what do you think @BenjaminBossan @pacman100
in principle it is not possible to be in a scenario where you can have many conditions matched
|
@NripeshN can you confirm you have access to an MPS compatible device and made sure it worked for you on some scenarios? |
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
Yes, unfortunately we cannot test this on CI and I don't have a Mac, so I can't test either. Ideally, we could have a few tests run on a Mac with mps to confirm that this change is sufficient. |
|
Hi @younesbelkada @BenjaminBossan |
|
if you can just run the common CI tests by running |
Not all tests pass unfortunately but I verified the tests that pass run on GPU and works perfectly fine |
Could you please report back which tests failed. Ideally, you could attach the whole log as a text file. |
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_00_Vanilla_MLP_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_adaption_prompt.py::AdaptionPromptTester::test_bf16_inference - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_01_Vanilla_MLP_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_02_Vanilla_MLP_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_03_Vanilla_MLP_4_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_04_Vanilla_MLP_5_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_05_Vanilla_MLP_6_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_06_Embedding_transformers_Conv1D_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_07_Embedding_transformers_Conv1D_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_08_Embedding_transformers_Conv1D_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_09_Conv2d_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_adaption_prompt.py::AdaptionPromptTester::test_save_pretrained - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_10_Conv2d_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_adaption_prompt.py::AdaptionPromptTester::test_save_pretrained_selected_adapters - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_11_Vanilla_MLP_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_12_Vanilla_MLP_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_13_Vanilla_MLP_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_14_Vanilla_MLP_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_15_Vanilla_MLP_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_16_Vanilla_MLP_6_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_17_Vanilla_MLP_7_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_18_Vanilla_MLP_8_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_19_Vanilla_MLP_9_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_20_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_21_transformers_Conv1D_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_22_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_23_Conv2d_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_24_Conv2d_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_25_Conv2d_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_26_Conv2d_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_27_Conv2d_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_28_Vanilla_MLP_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_29_Vanilla_MLP_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_30_Vanilla_MLP_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_31_Vanilla_MLP_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_32_Vanilla_MLP_5_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_33_Vanilla_MLP_6_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_34_Vanilla_MLP_7_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_35_Conv2d_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_36_Conv2d_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_37_Conv2d_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_38_Conv2d_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_39_Vanilla_MLP_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_40_Vanilla_MLP_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_41_Vanilla_MLP_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_42_Vanilla_MLP_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_43_Vanilla_MLP_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_44_Vanilla_MLP_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_45_Vanilla_MLP_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_46_Vanilla_MLP_8_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_47_Conv2d_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_48_Conv2d_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_49_Conv2d_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_50_Conv2d_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_51_Conv2d_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_52_Conv2d_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_53_Conv2d_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_00_Vanilla_MLP_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_54_Vanilla_MLP_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_01_Vanilla_MLP_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_02_Vanilla_MLP_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_55_Vanilla_MLP_2_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_56_Vanilla_MLP_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_03_Vanilla_MLP_4_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_04_Vanilla_MLP_5_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_57_Vanilla_MLP_6_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_05_Vanilla_MLP_6_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_58_Vanilla_MLP_7_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_06_Embedding_transformers_Conv1D_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_59_Vanilla_MLP_8_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_07_Embedding_transformers_Conv1D_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_60_Vanilla_MLP_9_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_08_Embedding_transformers_Conv1D_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_61_Conv2d_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_09_Conv2d_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_62_Conv2d_3_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_10_Conv2d_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_63_Conv2d_4_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_11_Vanilla_MLP_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_from_pretrained_config_construction_64_Conv2d_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_12_Vanilla_MLP_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_13_Vanilla_MLP_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_14_Vanilla_MLP_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_00_Vanilla_MLP_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_15_Vanilla_MLP_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_01_Vanilla_MLP_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_16_Vanilla_MLP_6_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_02_Vanilla_MLP_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_17_Vanilla_MLP_7_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_03_Vanilla_MLP_4_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_18_Vanilla_MLP_8_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_causal_lm - RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM:
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_04_Vanilla_MLP_5_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_19_Vanilla_MLP_9_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_05_Vanilla_MLP_6_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_20_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_21_transformers_Conv1D_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_06_Embedding_transformers_Conv1D_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_22_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_07_Embedding_transformers_Conv1D_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_23_Conv2d_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_08_Embedding_transformers_Conv1D_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_24_Conv2d_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_25_Conv2d_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_09_Conv2d_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_26_Conv2d_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_inference_safetensors_10_Conv2d_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_27_Conv2d_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_45_Vanilla_MLP_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_28_Vanilla_MLP_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_29_Vanilla_MLP_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_46_Vanilla_MLP_8_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_30_Vanilla_MLP_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_47_Conv2d_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_31_Vanilla_MLP_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_48_Conv2d_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_32_Vanilla_MLP_5_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_49_Conv2d_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_33_Vanilla_MLP_6_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_50_Conv2d_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_34_Vanilla_MLP_7_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_51_Conv2d_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_35_Conv2d_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_52_Conv2d_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_36_Conv2d_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_53_Conv2d_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_37_Conv2d_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_54_Vanilla_MLP_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_38_Conv2d_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_55_Vanilla_MLP_2_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_39_Vanilla_MLP_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_56_Vanilla_MLP_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_40_Vanilla_MLP_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_57_Vanilla_MLP_6_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_41_Vanilla_MLP_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_58_Vanilla_MLP_7_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_42_Vanilla_MLP_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_59_Vanilla_MLP_8_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_43_Vanilla_MLP_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_60_Vanilla_MLP_9_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_44_Vanilla_MLP_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_61_Conv2d_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_62_Conv2d_3_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_63_Conv2d_4_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_parameters_after_loading_model_64_Conv2d_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_00_Vanilla_MLP_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_01_Vanilla_MLP_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_02_Vanilla_MLP_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_03_Vanilla_MLP_4_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_04_Vanilla_MLP_5_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_05_Vanilla_MLP_6_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_06_Embedding_transformers_Conv1D_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_07_Embedding_transformers_Conv1D_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_08_Embedding_transformers_Conv1D_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_09_Conv2d_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_peft_model_device_map_10_Conv2d_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_00_Vanilla_MLP_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_feature_extraction - RuntimeError: Error(s) in loading state_dict for PeftModelForFeatureExtraction:
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_01_Vanilla_MLP_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_02_Vanilla_MLP_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_03_Vanilla_MLP_4_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_04_Vanilla_MLP_5_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_05_Vanilla_MLP_6_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_06_Embedding_transformers_Conv1D_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_07_Embedding_transformers_Conv1D_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_08_Embedding_transformers_Conv1D_3_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_09_Conv2d_1_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_10_Conv2d_2_LoRA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_11_Vanilla_MLP_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_12_Vanilla_MLP_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_13_Vanilla_MLP_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_14_Vanilla_MLP_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_15_Vanilla_MLP_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_16_Vanilla_MLP_6_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_17_Vanilla_MLP_7_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_18_Vanilla_MLP_8_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_19_Vanilla_MLP_9_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_20_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_21_transformers_Conv1D_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_22_transformers_Conv1D_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_23_Conv2d_1_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_24_Conv2d_2_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_25_Conv2d_3_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_26_Conv2d_4_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_27_Conv2d_5_IA3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_28_Vanilla_MLP_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_29_Vanilla_MLP_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_30_Vanilla_MLP_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_31_Vanilla_MLP_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_32_Vanilla_MLP_5_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_33_Vanilla_MLP_6_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_34_Vanilla_MLP_7_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_35_Conv2d_1_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_36_Conv2d_2_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_37_Conv2d_3_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_38_Conv2d_4_LOHA - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_39_Vanilla_MLP_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_40_Vanilla_MLP_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_41_Vanilla_MLP_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_42_Vanilla_MLP_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_43_Vanilla_MLP_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_question_answering - RuntimeError: Error(s) in loading state_dict for PeftModelForQuestionAnswering:
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_44_Vanilla_MLP_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_45_Vanilla_MLP_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_46_Vanilla_MLP_8_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_47_Conv2d_1_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_48_Conv2d_2_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_49_Conv2d_3_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_50_Conv2d_4_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_51_Conv2d_5_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_52_Conv2d_6_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_53_Conv2d_7_LOKR - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_54_Vanilla_MLP_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_55_Vanilla_MLP_2_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_56_Vanilla_MLP_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_57_Vanilla_MLP_6_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_58_Vanilla_MLP_7_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_59_Vanilla_MLP_8_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_60_Vanilla_MLP_9_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_61_Conv2d_1_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_62_Conv2d_3_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_63_Conv2d_4_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_custom_models.py::PeftCustomModelTester::test_save_pretrained_64_Conv2d_5_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_seq2seq_lm - RuntimeError: Error(s) in loading state_dict for PeftModelForSeq2SeqLM:
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_03_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_sequence_cls - RuntimeError: Error(s) in loading state_dict for PeftModelForSequenceClassification:
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_04_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_05_test_hf_internal_testing_tiny_random_OPTForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_09_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_10_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_11_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_token_classification - RuntimeError: Error(s) in loading state_dict for PeftModelForTokenClassification:
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_15_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_16_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_17_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_whisper - RuntimeError: Error(s) in loading state_dict for PeftModel:
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_21_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_22_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_23_test_hf_internal_testing_tiny_random_BloomForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_27_test_hf_internal_testing_tiny_random_gpt_neo_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_28_test_hf_internal_testing_tiny_random_gpt_neo_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_29_test_hf_internal_testing_tiny_random_gpt_neo_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_33_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_34_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_35_test_hf_internal_testing_tiny_random_GPTJForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_39_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_40_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_41_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_45_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_46_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_from_pretrained_config_construction_47_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_inference_safetensors_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_peft_model_device_map_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_03_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_04_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_05_test_hf_internal_testing_tiny_random_OPTForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_09_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_10_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_11_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_15_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_16_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_17_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_03_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_21_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_04_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_22_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_23_test_hf_internal_testing_tiny_random_BloomForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_09_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_10_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_27_test_hf_internal_testing_tiny_random_gpt_neo_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_28_test_hf_internal_testing_tiny_random_gpt_neo_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_29_test_hf_internal_testing_tiny_random_gpt_neo_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_15_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_16_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_33_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_34_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_35_test_hf_internal_testing_tiny_random_GPTJForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_21_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_22_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_39_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_40_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_41_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_27_test_hf_internal_testing_tiny_random_gpt_neo_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_28_test_hf_internal_testing_tiny_random_gpt_neo_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_45_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_46_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_33_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_47_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_34_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_39_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_40_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_45_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_46_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_03_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_04_test_hf_internal_testing_tiny_random_OPTForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_09_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_10_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_training_decoders_layer_indexing_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_15_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_16_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_21_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_22_test_hf_internal_testing_tiny_random_BloomForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_03_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_04_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_05_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_27_test_hf_internal_testing_tiny_random_gpt_neo_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_28_test_hf_internal_testing_tiny_random_gpt_neo_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_09_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_10_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_from_pretrained_config_construction_11_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_33_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_34_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_39_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_40_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_inference_safetensors_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_inference_safetensors_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_03_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_04_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_45_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_save_pretrained_selected_adapters_pickle_46_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_peft_model_device_map_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_peft_model_device_map_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_09_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_10_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_03_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_04_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_03_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_09_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_04_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_selected_adapters_pickle_10_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_05_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_09_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_training_encoder_decoders_layer_indexing_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_10_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_training_encoder_decoders_layer_indexing_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_save_pretrained_11_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_00_test_hf_internal_testing_tiny_random_BertModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_02_test_hf_internal_testing_tiny_random_BertModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_03_test_hf_internal_testing_tiny_random_BertModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_04_test_hf_internal_testing_tiny_random_BertModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_05_test_hf_internal_testing_tiny_random_BertModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_06_test_hf_internal_testing_tiny_random_RobertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_08_test_hf_internal_testing_tiny_random_RobertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_09_test_hf_internal_testing_tiny_random_RobertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_10_test_hf_internal_testing_tiny_random_RobertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_11_test_hf_internal_testing_tiny_random_RobertaModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_12_test_hf_internal_testing_tiny_random_DebertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_14_test_hf_internal_testing_tiny_random_DebertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_15_test_hf_internal_testing_tiny_random_DebertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_16_test_hf_internal_testing_tiny_random_DebertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_peft_model_device_map_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_17_test_hf_internal_testing_tiny_random_DebertaModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_peft_model_device_map_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_18_test_hf_internal_testing_tiny_random_DebertaV2Model_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_peft_model_device_map_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_peft_model_device_map_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_20_test_hf_internal_testing_tiny_random_DebertaV2Model_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_21_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_22_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_from_pretrained_config_construction_23_test_hf_internal_testing_tiny_random_DebertaV2Model_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_inference_safetensors_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_10_test_hf_internal_testing_tiny_random_RobertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_11_test_hf_internal_testing_tiny_random_RobertaModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_inference_safetensors_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_12_test_hf_internal_testing_tiny_random_DebertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_inference_safetensors_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_inference_safetensors_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_14_test_hf_internal_testing_tiny_random_DebertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_12_test_hf_internal_testing_tiny_random_DebertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_15_test_hf_internal_testing_tiny_random_DebertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_16_test_hf_internal_testing_tiny_random_DebertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_17_test_hf_internal_testing_tiny_random_DebertaModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_14_test_hf_internal_testing_tiny_random_DebertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_15_test_hf_internal_testing_tiny_random_DebertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_18_test_hf_internal_testing_tiny_random_DebertaV2Model_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_16_test_hf_internal_testing_tiny_random_DebertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_18_test_hf_internal_testing_tiny_random_DebertaV2Model_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_20_test_hf_internal_testing_tiny_random_DebertaV2Model_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_21_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_22_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_20_test_hf_internal_testing_tiny_random_DebertaV2Model_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_23_test_hf_internal_testing_tiny_random_DebertaV2Model_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_21_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_00_test_hf_internal_testing_tiny_random_BertModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_22_test_hf_internal_testing_tiny_random_DebertaV2Model_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_02_test_hf_internal_testing_tiny_random_BertModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_00_test_hf_internal_testing_tiny_random_BertModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_03_test_hf_internal_testing_tiny_random_BertModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_04_test_hf_internal_testing_tiny_random_BertModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_02_test_hf_internal_testing_tiny_random_BertModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_06_test_hf_internal_testing_tiny_random_RobertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_03_test_hf_internal_testing_tiny_random_BertModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_04_test_hf_internal_testing_tiny_random_BertModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_08_test_hf_internal_testing_tiny_random_RobertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_05_test_hf_internal_testing_tiny_random_BertModel_adalora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_training_layer_indexing_01_test_hf_internal_testing_tiny_random_BertModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_09_test_hf_internal_testing_tiny_random_RobertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_training_layer_indexing_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_06_test_hf_internal_testing_tiny_random_RobertaModel_ia3 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_selected_adapters_10_test_hf_internal_testing_tiny_random_RobertaModel_prompt_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_training_layer_indexing_13_test_hf_internal_testing_tiny_random_DebertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_07_test_hf_internal_testing_tiny_random_RobertaModel_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_training_layer_indexing_19_test_hf_internal_testing_tiny_random_DebertaV2Model_lora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_08_test_hf_internal_testing_tiny_random_RobertaModel_prefix_tuning - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_feature_extraction_models.py::PeftFeatureExtractionModelTester::test_save_pretrained_09_test_hf_internal_testing_tiny_random_RobertaModel_prompt_encoder - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_0_Lora_LoHa - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_1_Lora_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_2_Lora_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_3_Lora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_4_LoHa_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_5_LoHa_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_6_LoHa_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_7_LoKr_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_3_Lora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_4_LoHa_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_8_LoKr_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_5_LoHa_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_different_layers_9_AdaLora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_0_Lora_LoHa - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_6_LoHa_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_1_Lora_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_7_LoKr_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_2_Lora_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_8_LoKr_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_same_type_1_LoHa_x2 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_9_AdaLora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_same_type_2_LoKr_x2 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_same_type_0_Lora_x2 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_same_type_3_AdaLora_x2 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_8_LoKr_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_first_layer_same_type_4_OFT_x2 - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_9_AdaLora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_0_Lora_LoHa - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_1_Lora_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_2_Lora_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_3_Lora_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_4_LoHa_LoKr - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_5_LoHa_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_6_LoHa_OFT - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_target_last_layer_7_LoKr_AdaLora - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_multitask_prompt_tuning.py::MultiTaskPromptTuningTester::test_bf16_inference - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_multitask_prompt_tuning.py::MultiTaskPromptTuningTester::test_save_pretrained - safetensors_rust.SafetensorError: device mps is invalid
FAILED tests/test_mixed.py::TestMixedAdapterTypes::test_decoder_model - safetensors_rust.SafetensorError: device mps is invalid |
|
Thanks @NripeshN. So that's quite a lot of failing tests, but it looks like they're almost all related to |
Hey, |
Ideally, every failing test can be fixed by editing just a single file :) Unfortunately, I don't have a Mac, otherwise I'd investigate myself. But you can also paste the stacktrace for one of the failing tests, that should shed some light on the source of the error. |
load_peft_weights function
All tests now pass except bfloat16. |
Great, thanks. For my understanding, this means that if we use
Could you please paste the error? |
|
@NripeshN adding to what Benjamin said, make sure to use the latest version of pytorch as I believe they are adding more and more support for bf16 operations which were not supported before. |
Regardless if user casts it to MPS or not, if we use
This is the short summary FAILED tests/test_adaption_prompt.py::AdaptionPromptTester::test_bf16_inference - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_causal_lm - RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_feature_extraction - RuntimeError: Error(s) in loading state_dict for PeftModelForFeatureExtraction:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_question_answering - RuntimeError: Error(s) in loading state_dict for PeftModelForQuestionAnswering:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_seq2seq_lm - RuntimeError: Error(s) in loading state_dict for PeftModelForSeq2SeqLM:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_sequence_cls - RuntimeError: Error(s) in loading state_dict for PeftModelForSequenceClassification:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_token_classification - RuntimeError: Error(s) in loading state_dict for PeftModelForTokenClassification:
FAILED tests/test_auto.py::PeftAutoModelTester::test_peft_whisper - RuntimeError: Error(s) in loading state_dict for PeftModel:
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_00_test_hf_internal_testing_tiny_random_OPTForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_01_test_hf_internal_testing_tiny_random_OPTForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_02_test_hf_internal_testing_tiny_random_OPTForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_06_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_07_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_08_test_hf_internal_testing_tiny_random_GPTNeoXForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_12_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_13_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_14_test_hf_internal_testing_tiny_random_GPT2LMHeadModel_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_18_test_hf_internal_testing_tiny_random_BloomForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_19_test_hf_internal_testing_tiny_random_BloomForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_20_test_hf_internal_testing_tiny_random_BloomForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_24_test_hf_internal_testing_tiny_random_gpt_neo_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_25_test_hf_internal_testing_tiny_random_gpt_neo_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_26_test_hf_internal_testing_tiny_random_gpt_neo_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_30_test_hf_internal_testing_tiny_random_GPTJForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_31_test_hf_internal_testing_tiny_random_GPTJForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_32_test_hf_internal_testing_tiny_random_GPTJForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_36_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_37_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_38_test_hf_internal_testing_tiny_random_GPTBigCodeForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_42_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_43_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_decoder_models.py::PeftDecoderModelTester::test_generate_half_prec_44_test_HuggingFaceM4_tiny_random_LlamaForCausalLM_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_00_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_01_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_02_test_ybelkada_tiny_random_T5ForConditionalGeneration_calibrated_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_06_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_ia3 - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_07_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_lora - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_encoder_decoder_models.py::PeftEncoderDecoderModelTester::test_generate_half_prec_08_test_hf_internal_testing_tiny_random_BartForConditionalGeneration_prefix_tuning - TypeError: BFloat16 is not supported on MPS
FAILED tests/test_multitask_prompt_tuning.py::MultiTaskPromptTuningTester::test_bf16_inference - TypeError: BFloat16 is not supported on MPSThis is an example failing test tests/test_encoder_decoder_models.py:109: in test_generate_half_prec
self._test_generate_half_prec(model_id, config_cls, config_kwargs)
tests/testing_common.py:669: in _test_generate_half_prec
model = model.to(self.torch_device)
venv/lib/python3.10/site-packages/torch/nn/modules/module.py:1160: in to
return self._apply(convert)
venv/lib/python3.10/site-packages/torch/nn/modules/module.py:810: in _apply
module._apply(fn)
venv/lib/python3.10/site-packages/torch/nn/modules/module.py:810: in _apply
module._apply(fn)
venv/lib/python3.10/site-packages/torch/nn/modules/module.py:810: in _apply
module._apply(fn)
venv/lib/python3.10/site-packages/torch/nn/modules/module.py:833: in _apply
param_applied = fn(param)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
t = Parameter containing:
tensor([[-0.0334, 0.0074, -0.0030, ..., -0.0078, 0.0101, 0.0184],
[ 0.0000, 0.0000,... -0.0123, 0.0215],
[ 0.0125, 0.0046, 0.0162, ..., 0.0243, -0.0062, -0.0087]],
dtype=torch.bfloat16)
def convert(t):
if convert_to_format is not None and t.dim() in (4, 5):
return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None,
non_blocking, memory_format=convert_to_format)
> return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
E TypeError: BFloat16 is not supported on MPS |
I have installed the latest version of torch. I think they have not yet bought support to bf16 for device |
| @@ -30,6 +30,8 @@ | |||
| def infer_device(): | |||
| if torch.cuda.is_available(): | |||
| torch_device = "cuda" | |||
| elif hasattr(torch.backends, "mps") and torch.backends.mps.is_available(): | |||
| torch_device = torch.device("mps") | |||
There was a problem hiding this comment.
What do you think of warning users here that the MPS support is experimental and might lead to unexpected behaviour with safetensors and/or bf16?
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
…d multilayer_perceptron_lora.ipynb
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
BenjaminBossan
requested changes
Dec 13, 2023
There was a problem hiding this comment.
In general, this looks good and safe to add, thanks @NripeshN.
One thing I would consider: Even though we cannot run MPS tests on CI, we could still add a unit test for it which is skipped if MPS is not available. That way, if a developer runs the tests locally on an MPS-capable device, the test could discover potential bugs. WDYT?
| @@ -195,7 +195,7 @@ | |||
| } | |||
| ], | |||
| "source": [ | |||
| "ds = load_dataset('beans')" | |||
| "ds = load_dataset(\"beans\")" | |||
There was a problem hiding this comment.
Could you please undo the changes in this and the other notebook? I think they are probably added accidentally and have nothing to do with this PR.
There was a problem hiding this comment.
The changes were made when make style && make quality was run. Should not cause a problem right?
There was a problem hiding this comment.
Yes, I guess it should be okay this time.
Ideally we want to avoid completely unrelated changes, as that makes the code harder to review and commits more difficult to revert. Here I guess what happened is that you have installed the jupyter extension for black, which resulted in these files being updated.
BenjaminBossan
approved these changes
Dec 15, 2023
younesbelkada
approved these changes
Dec 15, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.