-
Notifications
You must be signed in to change notification settings - Fork 204
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tensorflow GPU install #1697
Comments
The exact equivalent is:
You could use Start project:
Add a system requirement on [system-requirements]
cuda = "12.0" Add tensorflow
Because of the |
This doesn't work in my case... There is a GPU on the machine and the drivers are installed. I can work around this with simply initializing the environment with [something]$ pixi add "tensorflow[and-cuda]" --pypi
WARN Defined custom mapping channel https://conda.anaconda.org/nvidia/ is missing from project channels
✔ Added tensorflow[and-cuda]
Added these as pypi-dependencies.
[something]$ cat pixi.toml
[project]
name = "something"
version = "0.1.0"
description = "Add a short description here"
channels = ["conda-forge"]
platforms = ["linux-64"]
[dependencies]
python = "<3.12"
[pypi-dependencies]
tensorflow = ">=2.17.0, <3"
[something]$ pixi shell
. "/tmp/pixi_env_0XQ.sh"
[something]$ . "/tmp/pixi_env_0XQ.sh"
(something) [something]$ python3 -c "import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))"
2024-07-30 13:30:05.468202: I external/local_xla/xla/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used.
2024-07-30 13:30:05.522137: I external/local_xla/xla/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used.
2024-07-30 13:30:05.585031: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-07-30 13:30:05.644926: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-07-30 13:30:05.660807: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-07-30 13:30:05.751123: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-07-30 13:30:13.635456: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
2024-07-30 13:30:19.458826: W tensorflow/core/common_runtime/gpu/gpu_device.cc:2343] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
[]
(something) [something]$ |
I see what went wrong, you have pointed out an error. We don't parse the pypi dependencies correct anymore. Thus the extras we're not added. This seems to work for me:
But to make it non pypi dependent you can do:
Which is what I would advice. Ps. this is the resulting command:
Not sure what all this output means but it seems to find my |
I could give it a shot and fix it ? |
Ah sorry missed your proposal! @ernimd Thanks anyway! |
Problem description
Hi, in the docs of tensorflow they advice to use:
Any idea how to reproduce this with pixi ?
The text was updated successfully, but these errors were encountered: