Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker下内核和pip兼容问题 #6554

Open
1 task done
SDAIer opened this issue Jan 7, 2025 · 0 comments
Open
1 task done

docker下内核和pip兼容问题 #6554

SDAIer opened this issue Jan 7, 2025 · 0 comments
Labels
pending This problem is yet to be addressed

Comments

@SDAIer
Copy link

SDAIer commented Jan 7, 2025

Reminder

  • I have read the README and searched the existing issues.

System Info

root@90c3997a1c1f:/app/data# llamafactory-cli env

  • llamafactory version: 0.9.2.dev0
  • Platform: Linux-3.10.0-1160.119.1.el7.x86_64-x86_64-with-glibc2.35
  • Python version: 3.10.12
  • PyTorch version: 2.3.0a0+ebedce2 (GPU)
  • Transformers version: 4.46.1
  • Datasets version: 3.1.0
  • Accelerate version: 1.0.1
  • PEFT version: 0.12.0
  • TRL version: 0.9.6
  • GPU type: NVIDIA A30

Reproduction

docker下运行,安装命令

git clone --depth 1 https://github.com/hiyouga/LLaMA-Factory.git
cd docker/docker-cuda/
docker compose up -d
docker compose exec llamafactory bash

为什么推理时提示内核不满足

Detected kernel version 3.10.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.

而且pip check很多程序不兼容,导致使用量化Int8总是报错,提示兼容性有问题


root@90c3997a1c1f:/app/src/saves/Llama-3.1-8B-Instruct/lora# pip check
cudf 23.12.0 has requirement pandas<1.6.0dev0,>=1.3, but you have pandas 2.2.3.
dask-cuda 23.12.0 has requirement pandas<1.6.0.dev0,>=1.3, but you have pandas 2.2.3.
dask-cudf 23.12.0 has requirement pandas<1.6.0dev0,>=1.3, but you have pandas 2.2.3.
spacy 3.7.2 has requirement typer<0.10.0,>=0.3.0, but you have typer 0.15.1.
weasel 0.3.4 has requirement typer<0.10.0,>=0.3.0, but you have typer 0.15.1.
cmake 3.28.1 is not supported on this platform
ninja 1.11.1.1 is not supported on this platform

Others

No response

@github-actions github-actions bot added the pending This problem is yet to be addressed label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pending This problem is yet to be addressed
Projects
None yet
Development

No branches or pull requests

1 participant