nest cuml one level deeper in python

[msarahan]

This is a step towards adding support for dynamic linking with wheels (splitting the shared libraries out into their own wheels). That's being tracked in rapidsai/build-planning#33

This PR performs a necessary step of moving the cuml folder one level deeper, such that the python folder becomes a parent of multiple full-fledged projects, instead of having the python folder be the top level of one python project. This is split into this PR because this change affects so many files. It's easier to review the actual changes of supporting the split wheel when you don't have to also consider these moves.

This change also affects devcontainers, and there will need to be a change similar to rapidsai/devcontainers#283 for cuml.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[msarahan]

@bdice this has the same failures as the totally-unrelated #5943, so I think it might be ready for review. Let me know if I need to do anything to address the failures.

[msarahan]

closing/reopening to re-run CI

[jameslamb]

I did this:

git grep 'python/'

And see a few other places that should be changed

cuml/.github/CODEOWNERS

Line 10 in 751ba82

python/setup.py @rapidsai/cuml-cmake-codeowners

cuml/ci/release/update-version.sh

Lines 40 to 44 in 751ba82

	# pyproject.toml versions
	sed_runner "s/rmm==.*\",/rmm==${NEXT_SHORT_TAG_PEP440}.*,>=0.0.0a0\",/g" python/pyproject.toml
	sed_runner "s/cudf==.*\",/cudf==${NEXT_SHORT_TAG_PEP440}.*,>=0.0.0a0\",/g" python/pyproject.toml
	sed_runner "s/pylibraft==.*\",/pylibraft==${NEXT_SHORT_TAG_PEP440}.*,>=0.0.0a0\",/g" python/pyproject.toml
	sed_runner "s/raft-dask==.*\",/raft-dask==${NEXT_SHORT_TAG_PEP440}.*,>=0.0.0a0\",/g" python/pyproject.toml

cuml/ci/release/update-version.sh

Line 69 in 751ba82

sed_runner "s|/branch-[^/]*/|/branch-${NEXT_SHORT_TAG}/|g" python/README.md

cuml/wiki/python/ESTIMATOR_GUIDE.md

Line 90 in 751ba82

There are some convenience [Mixins](../../python/common/mixins.py), that the estimator can inherit, can be used for indicating the preferred order (column or row major) as well as for sparse input capability.

cuml/wiki/python/ESTIMATOR_GUIDE.md

Line 92 in 751ba82

If other tags are needed, they are static (i.e. don't change depending on the instantiated estimator), and more than one estimator will use them, then implement a new [Mixin](../../python/common/mixins.py), if the tag will be used by a single class then implement the `_more_static_tags` method:

(not sure about this one):

cuml/docs/source/conf.py

Line 204 in 751ba82

'cuml/blob/{revision}/python/'

And then technically this one, although it looks like it's a leftover from an older state of these builds and actually isn't used for anything:

cuml/build.sh

Line 65 in 751ba82

PYTHON_DEPS_CLONE=${REPODIR}/python/external_repositories

[KyleFromNVIDIA]

Fixed the remaining usages of python/.

[jameslamb]

Thanks, left 2 more small suggestions but otherwise this looks good to me. I don't need to re-review.

[trxcllnt]

We might also need to update these lines to use the containers with the new UCX version:

-      "BASE": "rapidsai/devcontainers:24.08-cpp-cuda11.8-ucx1.15.0-openmpi-ubuntu22.04"
+      "BASE": "rapidsai/devcontainers:24.08-cpp-cuda11.8-ucx1.17.0-openmpi-ubuntu22.04"

-      "BASE": "rapidsai/devcontainers:24.08-cpp-cuda12.2-ucx1.15.0-openmpi-ubuntu22.04"
+      "BASE": "rapidsai/devcontainers:24.08-cpp-cuda12.2-ucx1.17.0-openmpi-ubuntu22.04"

[dantegd]

python and cmake changes lgtm

[KyleFromNVIDIA]

/merge