Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filter dd deprecation #1312

Merged
merged 4 commits into from
Feb 13, 2024
Merged

Conversation

rjzamora
Copy link
Member

Dask CUDA must use the deprecated dask.dataframe API until #1311 and rapidsai/cudf#15027 are both closed. This means that we must explicitly filter the following deprecation warning to avoid nighlty CI failures:

DeprecationWarning: The current Dask DataFrame implementation is deprecated. 
In a future release, Dask DataFrame will use new implementation that
contains several improvements including a logical query planning.
The user-facing DataFrame API will remain unchanged.

The new implementation is already available and can be enabled by
installing the dask-expr library:

    $ pip install dask-expr

and turning the query planning option on:

    >>> import dask
    >>> dask.config.set({'dataframe.query-planning': True})
    >>> import dask.dataframe as dd

API documentation for the new implementation is available at
https://docs.dask.org/en/stable/dask-expr-api.html

Any feedback can be reported on the Dask issue tracker
https://github.com/dask/dask/issues 

  import dask.dataframe as dd

This PR adds the (temporarily) necessary warning filter.

@rjzamora rjzamora requested a review from a team as a code owner February 12, 2024 17:43
@github-actions github-actions bot added the python python code needed label Feb 12, 2024
@rjzamora rjzamora added 2 - In Progress Currently a work in progress non-breaking Non-breaking change ci improvement Improvement / enhancement to an existing function labels Feb 12, 2024
Copy link
Member

@pentschev pentschev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rjzamora this looks ok but I want to make sure of what's the intent here, do we want to filter this warning for all users or only tests? If the latter it may be more appropriate to add this in the pyproject.toml.

@rjzamora
Copy link
Member Author

Good point @pentschev - I suppose it's probably best to constrain the filter to tests for now. I'll revise, thanks!

@github-actions github-actions bot removed the ci label Feb 12, 2024
@@ -3,7 +3,6 @@
if sys.platform != "linux":
raise ImportError("Only Linux is supported by Dask-CUDA at this time")


Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm surprised linting didn't complain about this. It doesn't matter so let's keep it like this.

Copy link
Member

@pentschev pentschev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @rjzamora !

@pentschev
Copy link
Member

Previous run passed, I merged the latest changes just in case. @rjzamora feel free to move this to "Ready for Review" and merging soon afterwards if there's nothing more in this PR. Thanks for working on it!

@rjzamora rjzamora added 5 - Ready to Merge Testing and reviews complete, ready to merge 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currently a work in progress 5 - Ready to Merge Testing and reviews complete, ready to merge labels Feb 12, 2024
@rjzamora
Copy link
Member Author

/merge

@rapids-bot rapids-bot bot merged commit 21376a0 into rapidsai:branch-24.04 Feb 13, 2024
24 checks passed
@rjzamora rjzamora deleted the filter-dd-deprecation branch February 13, 2024 03:47
younseojava pushed a commit to ROCm/dask-cuda-rocm that referenced this pull request Apr 16, 2024
Dask CUDA must use the deprecated `dask.dataframe` API until rapidsai#1311 and rapidsai/cudf#15027 are both closed. This means that we must explicitly filter the following deprecation warning to avoid nighlty CI failures:

```
DeprecationWarning: The current Dask DataFrame implementation is deprecated. 
In a future release, Dask DataFrame will use new implementation that
contains several improvements including a logical query planning.
The user-facing DataFrame API will remain unchanged.

The new implementation is already available and can be enabled by
installing the dask-expr library:

    $ pip install dask-expr

and turning the query planning option on:

    >>> import dask
    >>> dask.config.set({'dataframe.query-planning': True})
    >>> import dask.dataframe as dd

API documentation for the new implementation is available at
https://docs.dask.org/en/stable/dask-expr-api.html

Any feedback can be reported on the Dask issue tracker
https://github.com/dask/dask/issues 

  import dask.dataframe as dd
```

This PR adds the (temporarily) necessary warning filter.

Authors:
  - Richard (Rick) Zamora (https://github.com/rjzamora)
  - Peter Andreas Entschev (https://github.com/pentschev)

Approvers:
  - Peter Andreas Entschev (https://github.com/pentschev)

URL: rapidsai#1312
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team improvement Improvement / enhancement to an existing function non-breaking Non-breaking change python python code needed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants