Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

macOS 下是否可以用呢 #11

Open
askiter opened this issue May 8, 2024 · 0 comments
Open

macOS 下是否可以用呢 #11

askiter opened this issue May 8, 2024 · 0 comments

Comments

@askiter
Copy link

askiter commented May 8, 2024

我的m1 mac上安装了comfyui,可以跑起来
但是这个ComfyUI-Phi-3-mini会报错

Error occurred when executing Phi3mini_4k_ModelLoader_Zho:

Torch not compiled with CUDA enabled

File "/Users/askiter/AI/ComfyUI/execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "/Users/askiter/AI/ComfyUI/execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "/Users/askiter/AI/ComfyUI/execution.py", line 69, in map_node_over_list
results.append(getattr(obj, func)())
File "/Users/askiter/AI/ComfyUI/custom_nodes/ComfyUI-Phi-3-mini/Phi3mini.py", line 26, in load_model
model = AutoModelForCausalLM.from_pretrained(
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 558, in from_pretrained
return model_class.from_pretrained(
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3689, in from_pretrained
) = cls._load_pretrained_model(
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4123, in _load_pretrained_model
new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/transformers/modeling_utils.py", line 887, in _load_state_dict_into_meta_model
set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs)
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 298, in set_module_tensor_to_device
new_value = value.to(device)
File "/Users/askiter/AI/PyVenv3.10/lib/python3.10/site-packages/torch/cuda/init.py", line 284, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")

是否只能在有N卡的机器上跑呢?
谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant