Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to CCCL 2.2.0. #4052

Merged
merged 7 commits into from
Dec 20, 2023
Merged

Update to CCCL 2.2.0. #4052

merged 7 commits into from
Dec 20, 2023

Conversation

bdice
Copy link
Contributor

@bdice bdice commented Dec 7, 2023

This PR updates cuGraph to CCCL 2.2.0. Do not merge until all of RAPIDS is ready to update.

Depends on #3862.

Replaces #3516.

Copy link

copy-pr-bot bot commented Dec 7, 2023

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@bdice bdice added the DO NOT MERGE Hold off on merging; see PR for details label Dec 7, 2023
rapids-bot bot pushed a commit to rapidsai/rapids-cmake that referenced this pull request Dec 8, 2023
I saw an error (below) and @robertmaynard helped me identify that this change was needed.

I was building cuGraph ([this branch](rapidsai/cugraph#4052)) with rapids-cmake pointing to [this branch](NVIDIA/cuCollections#404) of cuCollections.
```
-- CPM: Adding package cuco@0.0.1 (cccl-2.2.0)
CMake Error at build/release/_deps/rapids-cmake-src/rapids-cmake/cmake/make_global.cmake:59 (set_target_properties):
  Attempt to promote imported target "CCCL::Thrust" to global scope (by
  setting IMPORTED_GLOBAL) which is not built in this directory.
Call Stack (most recent call first):
  build/release/_deps/rapids-cmake-src/rapids-cmake/cpm/find.cmake:189 (rapids_cmake_make_global)
  build/release/_deps/rapids-cmake-src/rapids-cmake/cpm/cccl.cmake:85 (rapids_cpm_find)
  build/release/_deps/cuco-src/cmake/thirdparty/get_cccl.cmake:18 (rapids_cpm_cccl)
  build/release/_deps/cuco-src/cmake/thirdparty/get_cccl.cmake:21 (find_and_configure_cccl)
  build/release/_deps/cuco-src/CMakeLists.txt:79 (include)
```

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Robert Maynard (https://github.com/robertmaynard)

URL: #500
@github-actions github-actions bot removed the cuGraph label Dec 8, 2023
@bdice bdice mentioned this pull request Dec 8, 2023
26 tasks
@bdice bdice self-assigned this Dec 15, 2023
@github-actions github-actions bot added the ci label Dec 16, 2023
@bdice bdice marked this pull request as ready for review December 18, 2023 15:34
@bdice bdice requested review from a team as code owners December 18, 2023 15:34
Comment on lines 14 to 15
set(rapids-cmake-repo bdice/rapids-cmake)
set(rapids-cmake-branch cuco-cccl-2.2.0)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will revert this before merging. Depends on NVIDIA/cuCollections#404 merging, and rapids-cmake being updated to use that commit in versions.json.

ci/build_cpp.sh Outdated
@@ -9,10 +9,18 @@ export CMAKE_GENERATOR=Ninja

rapids-print-env

LIBRMM_CHANNEL=$(rapids-get-pr-conda-artifact rmm 1404 cpp)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will revert changes to CI scripts that use upstream artifacts before merging.

cpp/CMakeLists.txt Show resolved Hide resolved
@bdice
Copy link
Contributor Author

bdice commented Dec 19, 2023

I don't have a way to test this build in CI with the private cugraph-ops build from https://github.com/rapidsai/cugraph-ops/pull/580. I see there is an error here in the Python conda builds, but it's because we haven't merged that PR to cugraph-ops yet. https://github.com/rapidsai/cugraph/actions/runs/7229496902/job/19701156504?pr=4052#step:7:641

I have tested this locally and it should be fine. We may have to admin-merge this PR depending on the build order / timing of the other repositories, since it's so far down the dependency tree (rmm -> raft -> cugraph-ops -> cugraph). The builds will work themselves out with time, after all the dependencies are rebuilt.

Full error below: it comes from thrust_create_target with an outdated cugraph-ops-config.cmake. This is fixed in https://github.com/rapidsai/cugraph-ops/pull/580.

      -- Found Thrust: /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/rapids/cmake/thrust/thrust-config.cmake (found suitable exact version "2.2.0.0")
      -- Found CCCL: /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/rapids/cmake/cccl/cccl-config.cmake (found version "2.2.0.0")
      -- Found rmm: /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/rmm/rmm-config.cmake (found version "24.02.0")
      -- Found cuco: /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/cuco/cuco-config.cmake (found version "0.0.1")
      -- Found OpenMP_CXX: -fopenmp (found version "4.5")
      -- Found OpenMP: TRUE (found version "4.5")
      -- Found raft: /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/raft/raft-config.cmake (found version "24.02.0")
      CMake Error at /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/targets/sbsa-linux/lib/cmake/thrust/thrust-config.cmake:225 (message):
        The version of CUB found by CMake is not compatible with this release of
        Thrust.  CUB is now included in the CUDA Toolkit, so you no longer need to
        use your own checkout of CUB.  Pass IGNORE_CUB_VERSION_CHECK to
        thrust_create_target to ignore.  (CUB 2.2.0.0, Thrust 2.0.1.0).
      Call Stack (most recent call first):
        /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/cugraph-ops/cugraph-ops-config.cmake:150 (thrust_create_target)
        /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/cugraph/cugraph-dependencies.cmake:34 (find_package)
        /opt/conda/conda-bld/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/cmake/cugraph/cugraph-config.cmake:72 (include)
        CMakeLists.txt:46 (find_package)
      
      
      -- Configuring incomplete, errors occurred!

@bdice bdice added improvement Improvement / enhancement to an existing function breaking Breaking change and removed DO NOT MERGE Hold off on merging; see PR for details labels Dec 19, 2023
@vyasr
Copy link
Contributor

vyasr commented Dec 19, 2023

/merge

@rapids-bot rapids-bot bot merged commit 34054b1 into rapidsai:branch-24.02 Dec 20, 2023
85 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking Breaking change ci CMake cuGraph improvement Improvement / enhancement to an existing function
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants