You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Trying to run on my GPU-less laptop, and I just want to try running inference locally with
PYTHONPATH=$(git rev-parse --show-toplevel) torchrun llama_models/scripts/example_chat_completion.py $CHECKPOINT_DIR
I'm getting the error:
File "/home/bill/.venv/lib/python3.11/site-packages/torch/distributed/distributed_c10d.py", line 1750, in _new_process_group_helper
raise RuntimeError("Distributed package doesn't have NCCL built in") ^^^
^^^ ^raise RuntimeError("Distributed package doesn't have NCCL built in")^
Is there a configuration for the script that will run without NCCL? Thanks
The text was updated successfully, but these errors were encountered:
Trying to run on my GPU-less laptop, and I just want to try running inference locally with
PYTHONPATH=$(git rev-parse --show-toplevel) torchrun llama_models/scripts/example_chat_completion.py $CHECKPOINT_DIR
I'm getting the error:
Is there a configuration for the script that will run without NCCL? Thanks
The text was updated successfully, but these errors were encountered: