Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial support blackwell #1481

Merged
merged 15 commits into from
Jan 22, 2025
Merged

Initial support blackwell #1481

Show file tree
Hide file tree
Changes from 13 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
a9c63ee
initial support blackwell
johnnynunez Jan 22, 2025
5f2b5af
Update CHANGELOG.md
johnnynunez Jan 22, 2025
c6c4626
Update CMakeLists.txt
johnnynunez Jan 22, 2025
8cbbcf5
Update CHANGELOG.md
johnnynunez Jan 22, 2025
713e947
fix build-cuda.sh
johnnynunez Jan 22, 2025
b803bdf
fix build-cuda.sh
johnnynunez Jan 22, 2025
b378e24
fix cuda 12.7 build-cuda.sh
johnnynunez Jan 22, 2025
d65d6e1
Update build-cuda.sh
johnnynunez Jan 22, 2025
1bc0fd8
Update cuda from 12.6.2 to 12.6.3
johnnynunez Jan 22, 2025
2d1fe52
Merge remote-tracking branch 'origin/main'
johnnynunez Jan 22, 2025
c230292
Update .github/workflows/python-package.yml
johnnynunez Jan 22, 2025
9281880
Update install_cuda.py
johnnynunez Jan 22, 2025
517d186
Update install_cuda.sh
johnnynunez Jan 22, 2025
4fb75fe
Update .github/scripts/build-cuda.sh
matthewdouglas Jan 22, 2025
0e36e8d
Update install_cuda.sh
matthewdouglas Jan 22, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 7 additions & 3 deletions .github/scripts/build-cuda.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,13 @@ declare build_os
declare cuda_version

set -xeuo pipefail
build_capability="50;52;60;61;70;75;80;86;89;90"
[[ "${cuda_version}" == 11.7.* ]] && build_capability=${build_capability%??????}
[[ "${cuda_version}" == 11.8.* ]] && build_capability=${build_capability%???}
build_capability="50;52;60;61;70;75;80;86;89;90;100;120"
remove_for_11_7=";86;89;90;100;120"
matthewdouglas marked this conversation as resolved.
Show resolved Hide resolved
remove_for_11_8=";89;90;100;120"
remove_for_lt_12_7=";100;120"
[[ "${cuda_version}" == 11.7.* ]] && build_capability=$(sed 's|'"$remove_for_11_7"'||g' <<< "$build_capability")
[[ "${cuda_version}" == 11.8.* ]] && build_capability=$(sed 's|'"$remove_for_11_8"'||g' <<< "$build_capability")
[[ "${cuda_version}" < 12.7 ]] && build_capability=$(sed 's|'"$remove_for_lt_12_7"'||g; s|'"${remove_for_lt_12_7#;}"';||g' <<< "$build_capability")
[[ "${build_os}" = windows-* ]] && python3 -m pip install ninja

if [ "${build_os:0:6}" == ubuntu ]; then
Expand Down
6 changes: 6 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,9 @@
### 0.45.1

#### Improvements:

- Initial Support Blackwell B100 GPUs, RTX 50 Blackwell series GPUs and Jetson Thor Blackwell

### 0.43.3

#### Improvements:
Expand Down
13 changes: 12 additions & 1 deletion CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
# - CUDA_VERSION: The expected CUDA version, for sanity checking. The actual version
# is whatever CMake finds on your path.
# - COMPUTE_CAPABILITY: Which GPU Arch/Compute codes to provide to NVCC.
# Separate by semicolons, i.e. `-DCOMPUTE_CAPABILITY=89;90`
# Separate by semicolons, i.e. `-DCOMPUTE_CAPABILITY=89;90;100;120`
# Check your compute capability here: https://developer.nvidia.com/cuda-gpus
# - PTXAS_VERBOSE: Pass the `-v` option to the PTX Assembler
cmake_minimum_required(VERSION 3.22.1)
Expand Down Expand Up @@ -122,6 +122,17 @@ if(BUILD_CUDA)
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL 89 90)
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL_MAJOR 90)
endif()
# CUDA 12.7 adds support for Blackwell B100.
if (CMAKE_CUDA_COMPILER_VERSION VERSION_GREATER_EQUAL "12.7")
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL 100)
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL_MAJOR 100)
endif()

# CUDA 12.8 adds support for RTX 50 Blackwell.
if (CMAKE_CUDA_COMPILER_VERSION VERSION_GREATER_EQUAL "12.8")
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL 101 120)
list(APPEND CMAKE_CUDA_ARCHITECTURES_ALL_MAJOR 101 120)
endif()
endif()

string(APPEND CMAKE_CUDA_FLAGS " --use_fast_math")
Expand Down
2 changes: 1 addition & 1 deletion install_cuda.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ URL122=https://developer.download.nvidia.com/compute/cuda/12.2.2/local_installer
URL123=https://developer.download.nvidia.com/compute/cuda/12.3.2/local_installers/cuda_12.3.2_545.23.08_linux.run
URL124=https://developer.download.nvidia.com/compute/cuda/12.4.1/local_installers/cuda_12.4.1_550.54.15_linux.run
URL125=https://developer.download.nvidia.com/compute/cuda/12.5.1/local_installers/cuda_12.5.1_555.42.06_linux.run
URL126=https://developer.download.nvidia.com/compute/cuda/12.6.2/local_installers/cuda_12.6.2_560.35.03_linux.run
URL126=https://developer.download.nvidia.com/compute/cuda/12.6.3/local_installers/cuda_12.6.2_560.35.03_linux.run
matthewdouglas marked this conversation as resolved.
Show resolved Hide resolved

CUDA_VERSION=$1
BASE_PATH=$2
Expand Down
Loading