Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] Architecture mismatch error #6092

Closed
tbhaxor opened this issue May 2, 2023 · 11 comments
Closed

[QUESTION] Architecture mismatch error #6092

tbhaxor opened this issue May 2, 2023 · 11 comments

Comments

@tbhaxor
Copy link

tbhaxor commented May 2, 2023

Which Kokkos_ARCH_ should I use for the NVIDIA Tesla V100 cards.

I am using it with athenapk and it is failing with error

==> Error: Spec 'cuda@11.4.0' matches no installed packages.
Kokkos::Cuda::initialize ERROR: likely mismatch of architecture

Currently I am using -DKokkos_ARCH_VOLTA72=ON, this caused error

@tbhaxor
Copy link
Author

tbhaxor commented May 2, 2023

In the wikipedia it also mention VOLTA https://en.wikipedia.org/wiki/List_of_Nvidia_graphics_processing_units

@masterleinad
Copy link
Contributor

Kokkos_ARCH_VOLTA70=ON.

@masterleinad
Copy link
Contributor

In general, the last two digits match the compute capability of the architecture to use.

@tbhaxor
Copy link
Author

tbhaxor commented May 2, 2023

Kokkos_ARCH_VOLTA70=ON.

And, how did you find it?

Where is this documented?

@stanmoore1
Copy link
Contributor

See table here: https://en.wikipedia.org/wiki/CUDA

@stanmoore1
Copy link
Contributor

stanmoore1 commented May 2, 2023

Also see this link: https://github.com/kokkos/kokkos/wiki/Compiling EDIT: that link is deprecated. You can see the current list here:

https://github.com/kokkos/kokkos/blob/develop/cmake/kokkos_arch.cmake#L84

@tbhaxor
Copy link
Author

tbhaxor commented May 2, 2023

See table here: https://en.wikipedia.org/wiki/CUDA

Ohk, since there are only two arch versions, its easy to test. Can we have a GPU product to Kokkos arch mapping? That would be a great help as mentioned in kokkos/kokkos-core-wiki#370

@masterleinad
Copy link
Contributor

Also, note that the architecture is auto-detected when using CMake and configuring on a compute node.

@tbhaxor
Copy link
Author

tbhaxor commented May 2, 2023

Yes, it does but not on HPC login nodes where we have only CPU and use slurm scripts to schedule jobs for GPU nodes.

@masterleinad
Copy link
Contributor

Right, but you could also execute https://github.com/kokkos/kokkos/blob/develop/cmake/compile_tests/cuda_compute_capability.cc on a compute node (if configuring Kokkos in a job script is too difficult).

@tbhaxor
Copy link
Author

tbhaxor commented May 2, 2023

Great @masterleinad this would solve issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants