Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于权重加载运行 #3

Open
421212-huv opened this issue Feb 26, 2025 · 4 comments
Open

关于权重加载运行 #3

421212-huv opened this issue Feb 26, 2025 · 4 comments

Comments

@421212-huv
Copy link

torch和 torchvision的版本号方便说一下吗,我加载模型的时候总出现不匹配问题

@shenyunhang
Copy link
Collaborator

以下的版本试过是没问题的:

torch==2.6.0
torchvision==0.20.0
transformers==4.49.0

也可以看下是不是模型加载错了。

@421212-huv
Copy link
Author

现在遇见了问题,我用的torch==2.6.0与torchvision==0.20.0冲突了,所有我下载了torch==2.5.0,然后cuda版本是12.4,我下载了flash_attn-2.7.4.post1+cu12torch2.5cxx11abiTRUE-cp310-cp310-linux_x86_64.whl解析了,出现了ImportError: /ssd/luying/anaconda3/envs/long-vita-1/lib/python3.10/site-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c105ErrorC2ENS_14SourceLocationENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE这个错误,如何解决

@shenyunhang
Copy link
Collaborator

可以试试我们的镜像:
shenyunhang/pytorch:24.11-py3_2024-1224
https://hub.docker.com/repository/docker/shenyunhang/pytorch/tags

或者nvidia提供的镜像:
https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch/tags

@421212-huv
Copy link
Author

好的,感谢回复

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants