Skip to content

Commit

Permalink
Update JNI build to support nvcomp4 (#2217)
Browse files Browse the repository at this point in the history
* update JNI build to support nvcomp4

Signed-off-by: Peixin Li <pxLi@nyu.edu>
Co-authored-by: Yinqing Hao <haoyinqing@gmail.com>

* update cudf submodule ref to latest

* update rapids-cmake.sha

---------

Signed-off-by: Peixin Li <pxLi@nyu.edu>
Co-authored-by: Yinqing Hao <haoyinqing@gmail.com>
  • Loading branch information
pxLi and yinqingh authored Sep 6, 2024
1 parent 4817761 commit 0bbefc0
Show file tree
Hide file tree
Showing 4 changed files with 5 additions and 7 deletions.
2 changes: 0 additions & 2 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -605,8 +605,6 @@
<directory>${libcudfjni.build.path}</directory>
<includes>
<include>libnvcomp.so</include>
<include>libnvcomp_gdeflate.so</include>
<include>libnvcomp_bitcomp.so</include>
</includes>
</resource>
</resources>
Expand Down
2 changes: 1 addition & 1 deletion thirdparty/cudf
Submodule cudf updated 37 files
+14 −14 .github/workflows/build.yaml
+1 −1 .github/workflows/pandas-tests.yaml
+24 −24 .github/workflows/pr.yaml
+3 −3 .github/workflows/pr_issue_status_automation.yml
+12 −12 .github/workflows/test.yaml
+1 −1 README.md
+0 −2 ci/build_wheel_cudf.sh
+0 −2 ci/build_wheel_pylibcudf.sh
+4 −4 conda/environments/all_cuda-118_arch-x86_64.yaml
+4 −4 conda/environments/all_cuda-125_arch-x86_64.yaml
+2 −2 conda/recipes/custreamz/meta.yaml
+2 −2 conda/recipes/libcudf/conda_build_config.yaml
+34 −0 cpp/examples/billion_rows/CMakeLists.txt
+44 −0 cpp/examples/billion_rows/README.md
+94 −0 cpp/examples/billion_rows/brc.cpp
+116 −0 cpp/examples/billion_rows/brc_chunks.cpp
+171 −0 cpp/examples/billion_rows/brc_pipeline.cpp
+47 −0 cpp/examples/billion_rows/common.hpp
+112 −0 cpp/examples/billion_rows/groupby_results.cpp
+55 −0 cpp/examples/billion_rows/groupby_results.hpp
+1 −0 cpp/examples/build.sh
+9 −5 dependencies.yaml
+35 −3 docs/cudf/source/cudf_pandas/faq.md
+1 −3 java/pom.xml
+0 −3 java/src/main/java/ai/rapids/cudf/NativeDepsLoader.java
+2 −3 java/src/main/native/CMakeLists.txt
+1 −1 python/cudf/cudf/core/_internals/expressions.py
+1 −1 python/cudf/cudf/core/dataframe.py
+1 −1 python/cudf/cudf/core/series.py
+2 −0 python/cudf/cudf/tests/pytest.ini
+5 −1 python/cudf/cudf_pandas_tests/third_party_integration_tests/dependencies.yaml
+1 −0 python/cudf/pyproject.toml
+1 −0 python/cudf_polars/pyproject.toml
+2 −1 python/custreamz/pyproject.toml
+3 −0 python/dask_cudf/pyproject.toml
+1 −2 python/libcudf/CMakeLists.txt
+1 −0 python/pylibcudf/pyproject.toml
2 changes: 1 addition & 1 deletion thirdparty/cudf-pins/rapids-cmake.sha
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0652a0ac9f8fd589ecd6c220da313a7c8bec2abd
3c9bed0cbd0b2ebcdcc5676c83efc1331f22c52c
6 changes: 3 additions & 3 deletions thirdparty/cudf-pins/versions.json
Original file line number Diff line number Diff line change
Expand Up @@ -120,15 +120,15 @@
"git_url" : "https://github.com/NVIDIA/nvcomp.git",
"proprietary_binary" :
{
"aarch64-linux" : "https://developer.download.nvidia.com/compute/nvcomp/${version}/local_installers/nvcomp_${version}_SBSA_${cuda-toolkit-version-mapping}.tgz",
"x86_64-linux" : "https://developer.download.nvidia.com/compute/nvcomp/${version}/local_installers/nvcomp_${version}_x86_64_${cuda-toolkit-version-mapping}.tgz"
"aarch64-linux" : "https://developer.download.nvidia.com/compute/nvcomp/${version}/local_installers/nvcomp-linux-sbsa-${version}-cuda${cuda-toolkit-version-mapping}.tar.gz",
"x86_64-linux" : "https://developer.download.nvidia.com/compute/nvcomp/${version}/local_installers/nvcomp-linux-x86_64-${version}-cuda${cuda-toolkit-version-mapping}.tar.gz"
},
"proprietary_binary_cuda_version_mapping" :
{
"11" : "11.x",
"12" : "12.x"
},
"version" : "3.0.6"
"version" : "4.0.1"
},
"nvtx3" :
{
Expand Down

0 comments on commit 0bbefc0

Please sign in to comment.