-
Notifications
You must be signed in to change notification settings - Fork 908
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add experimental filesystem="arrow"
support in dask_cudf.read_parquet
#16684
Add experimental filesystem="arrow"
support in dask_cudf.read_parquet
#16684
Commits on Aug 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 469bc5e - Browse repository at this point
Copy the full SHA 469bc5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f20cc25 - Browse repository at this point
Copy the full SHA f20cc25View commit details
Commits on Aug 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8f0f598 - Browse repository at this point
Copy the full SHA 8f0f598View commit details -
Configuration menu - View commit details
-
Copy full SHA for 64fd701 - Browse repository at this point
Copy the full SHA 64fd701View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e0c902 - Browse repository at this point
Copy the full SHA 8e0c902View commit details -
Configuration menu - View commit details
-
Copy full SHA for 18e1c08 - Browse repository at this point
Copy the full SHA 18e1c08View commit details
Commits on Aug 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5215a05 - Browse repository at this point
Copy the full SHA 5215a05View commit details -
Configuration menu - View commit details
-
Copy full SHA for c51a7bb - Browse repository at this point
Copy the full SHA c51a7bbView commit details -
Configuration menu - View commit details
-
Copy full SHA for b7a90c1 - Browse repository at this point
Copy the full SHA b7a90c1View commit details
Commits on Aug 30, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 43274e2 - Browse repository at this point
Copy the full SHA 43274e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 63c3f04 - Browse repository at this point
Copy the full SHA 63c3f04View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1bd43c - Browse repository at this point
Copy the full SHA a1bd43cView commit details
Commits on Sep 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e3ca47f - Browse repository at this point
Copy the full SHA e3ca47fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 12c09a5 - Browse repository at this point
Copy the full SHA 12c09a5View commit details
Commits on Sep 4, 2024
-
Configuration menu - View commit details
-
Copy full SHA for daee7ec - Browse repository at this point
Copy the full SHA daee7ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for d068103 - Browse repository at this point
Copy the full SHA d068103View commit details
Commits on Sep 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 257eb26 - Browse repository at this point
Copy the full SHA 257eb26View commit details
Commits on Sep 6, 2024
-
Make isinstance check pass for proxy ndarrays (rapidsai#16601)
Closes rapidsai#14537. Authors: - Matthew Murray (https://github.com/Matt711) - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - GALI PREM SAGAR (https://github.com/galipremsagar) - Matthew Roeschke (https://github.com/mroeschke) - Vyas Ramasubramani (https://github.com/vyasr) URL: rapidsai#16601
Configuration menu - View commit details
-
Copy full SHA for ec38b1e - Browse repository at this point
Copy the full SHA ec38b1eView commit details -
Performance improvement for strings::slice for wide strings (rapidsai…
…#16574) Improves performance of wide strings (avg > 64 bytes) when using `cudf::strings::slice_strings`. Addresses some concerns from issue rapidsai#15924 Authors: - David Wendt (https://github.com/davidwendt) Approvers: - Bradley Dice (https://github.com/bdice) - Muhammad Haseeb (https://github.com/mhaseeb123) URL: rapidsai#16574
Configuration menu - View commit details
-
Copy full SHA for 853c76b - Browse repository at this point
Copy the full SHA 853c76bView commit details -
Configuration menu - View commit details
-
Copy full SHA for bdd2bab - Browse repository at this point
Copy the full SHA bdd2babView commit details -
Configuration menu - View commit details
-
Copy full SHA for d943d8d - Browse repository at this point
Copy the full SHA d943d8dView commit details
Commits on Sep 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for eb9eee0 - Browse repository at this point
Copy the full SHA eb9eee0View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9c5147 - Browse repository at this point
Copy the full SHA b9c5147View commit details
Commits on Sep 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ec04e78 - Browse repository at this point
Copy the full SHA ec04e78View commit details
Commits on Sep 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e391789 - Browse repository at this point
Copy the full SHA e391789View commit details -
Configuration menu - View commit details
-
Copy full SHA for e154d01 - Browse repository at this point
Copy the full SHA e154d01View commit details
Commits on Sep 24, 2024
-
Intentionally leak thread_local CUDA resources to avoid crash (part 1) (
rapidsai#16787) The NVbench application `PARQUET_READER_NVBENCH` in libcudf currently crashes with the segmentation fault. To reproduce: ``` ./PARQUET_READER_NVBENCH -d 0 -b 1 --run-once -a io_type=FILEPATH -a compression_type=SNAPPY -a cardinality=0 -a run_length=1 ``` The root cause is that some (1) `thread_local` objects on the main thread in `libcudf` and (2) `static` objects in `kvikio` are destroyed after `cudaDeviceReset()` in NVbench and upon program termination. These objects should simply be leaked, since their destructors making CUDA calls upon program termination constitutes UB in CUDA. This simple PR is the cuDF side of the fix. The other part is done here rapidsai/kvikio#462. closes rapidsai#13229 Authors: - Tianyu Liu (https://github.com/kingcrimsontianyu) - Vukasin Milovanovic (https://github.com/vuule) Approvers: - Vukasin Milovanovic (https://github.com/vuule) - Nghia Truong (https://github.com/ttnghia) URL: rapidsai#16787
Configuration menu - View commit details
-
Copy full SHA for 3246d67 - Browse repository at this point
Copy the full SHA 3246d67View commit details -
Access Frame attributes instead of ColumnAccessor attributes when ava…
…ilable (rapidsai#16652) There are some places where a public object like `DataFrame` or `Index` accesses a `ColumnAccessor` attribute when it's accessible in a shared subclass attribute instead (like `Frame`). In an effort to access the `ColumnAccessor` less, replaced usages of `._data.attribute` with a `Frame` specific attribute` Authors: - Matthew Roeschke (https://github.com/mroeschke) - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - GALI PREM SAGAR (https://github.com/galipremsagar) URL: rapidsai#16652
Configuration menu - View commit details
-
Copy full SHA for 2f424f2 - Browse repository at this point
Copy the full SHA 2f424f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 362195d - Browse repository at this point
Copy the full SHA 362195dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ce83d4 - Browse repository at this point
Copy the full SHA 4ce83d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d87013 - Browse repository at this point
Copy the full SHA 4d87013View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5b272a - Browse repository at this point
Copy the full SHA e5b272aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d87c54 - Browse repository at this point
Copy the full SHA 8d87c54View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8cfe71e - Browse repository at this point
Copy the full SHA 8cfe71eView commit details -
Configuration menu - View commit details
-
Copy full SHA for badf359 - Browse repository at this point
Copy the full SHA badf359View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c1c5ae - Browse repository at this point
Copy the full SHA 4c1c5aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f1d925 - Browse repository at this point
Copy the full SHA 3f1d925View commit details
Commits on Sep 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8c267c7 - Browse repository at this point
Copy the full SHA 8c267c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 91d2d77 - Browse repository at this point
Copy the full SHA 91d2d77View commit details -
Configuration menu - View commit details
-
Copy full SHA for 239639f - Browse repository at this point
Copy the full SHA 239639fView commit details -
Configuration menu - View commit details
-
Copy full SHA for c944a52 - Browse repository at this point
Copy the full SHA c944a52View commit details -
Configuration menu - View commit details
-
Copy full SHA for 791a4fd - Browse repository at this point
Copy the full SHA 791a4fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c5ee6d - Browse repository at this point
Copy the full SHA 4c5ee6dView commit details -
Build
cudf-polars
withbuild.sh
(rapidsai#16898)This PR adds `cudf-polars` to the top level build script. Authors: - https://github.com/brandon-b-miller - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - GALI PREM SAGAR (https://github.com/galipremsagar) - Jake Awe (https://github.com/AyodeAwe) URL: rapidsai#16898
Configuration menu - View commit details
-
Copy full SHA for 4d28db7 - Browse repository at this point
Copy the full SHA 4d28db7View commit details -
Fix DataFrame.drop(columns=cudf.Series/Index, axis=1) (rapidsai#16712)
Before when `columns=` was a `cudf.Series/Index` we would call `return array.unique.to_pandas()`, but `.unique` is a method not a property so this would have raised an error. Also took the time to refactor the helper methods here and push down the `errors=` keyword to `Frame._drop_column` Authors: - Matthew Roeschke (https://github.com/mroeschke) Approvers: - Bradley Dice (https://github.com/bdice) URL: rapidsai#16712
Configuration menu - View commit details
-
Copy full SHA for 9aa5aca - Browse repository at this point
Copy the full SHA 9aa5acaView commit details -
[DOC] Update Pylibcudf doc strings (rapidsai#16810)
This PR is a first pass at rapidsai#15937. We will close rapidsai#15937 after rapidsai#15162 is closed Authors: - Matthew Murray (https://github.com/Matt711) Approvers: - GALI PREM SAGAR (https://github.com/galipremsagar) URL: rapidsai#16810
Configuration menu - View commit details
-
Copy full SHA for 42a15ee - Browse repository at this point
Copy the full SHA 42a15eeView commit details -
Optimization of tdigest merge aggregation. (rapidsai#16780)
Fixes rapidsai#16625 This PR fixes a slow implementation of the centroid merging step during the tdigest merge aggregation. Previously it was doing a linear march over the individual tdigests per group and merging them one by one. This led to terrible performance for large numbers of groups. In principle though, all this really was doing was a segmented sort of centroid values. So that's what this PR changes it to. Speedup for 1,000,000 input tidests with 1,000,000 individual groups is ~1000x, ``` Old --------------------------------------------------------------------------------------------------------------- Benchmark Time CPU Iterations --------------------------------------------------------------------------------------------------------------- TDigest/many_tiny_groups/1000000/1/1/10000/iterations:8/manual_time 7473 ms 7472 ms 8 TDigest/many_tiny_groups2/1000000/1/1/1000/iterations:8/manual_time 7433 ms 7431 ms 8 ``` ``` New --------------------------------------------------------------------------------------------------------------- Benchmark Time CPU Iterations --------------------------------------------------------------------------------------------------------------- TDigest/many_tiny_groups/1000000/1/1/10000/iterations:8/manual_time 6.72 ms 6.79 ms 8 TDigest/many_tiny_groups2/1000000/1/1/1000/iterations:8/manual_time 1.24 ms 1.32 ms 8 ``` Authors: - https://github.com/nvdbaranec - Muhammad Haseeb (https://github.com/mhaseeb123) - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - Muhammad Haseeb (https://github.com/mhaseeb123) - Nghia Truong (https://github.com/ttnghia) - Mike Wilson (https://github.com/hyperbolic2346) URL: rapidsai#16780
Configuration menu - View commit details
-
Copy full SHA for 2c5bb57 - Browse repository at this point
Copy the full SHA 2c5bb57View commit details -
Display deltas for
cudf.pandas
test summary (rapidsai#16864)This PR displays delta's for CPU and GPU usage metrics that are extracted from `cudf.pandas` pytests. Authors: - GALI PREM SAGAR (https://github.com/galipremsagar) Approvers: - Jake Awe (https://github.com/AyodeAwe) URL: rapidsai#16864
Configuration menu - View commit details
-
Copy full SHA for ed19b2e - Browse repository at this point
Copy the full SHA ed19b2eView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa492f5 - Browse repository at this point
Copy the full SHA aa492f5View commit details