Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure GPU is used for input transposing of host arrays #3835

Merged
merged 3 commits into from
May 7, 2021

Conversation

dantegd
Copy link
Member

@dantegd dantegd commented May 6, 2021

Closes issue #3832

Related to #3767

cc @teju85 and @venkywonka and @vinaydes who are working on RF

Will be profiling the solution before flipping the PR to ready to review

Quick profiling, on a 2070S laptop,average of 10 runs of a simple LinearRegression.fit (that expects data in F format), with a X matrix of 500 columns with 100000 rows shows:

  • Before the fix:
common.input_utils.input_to_cuml_array                     :   0.1795 s
  • After the fix:
common.input_utils.input_to_cuml_array                     :   0.0632 s

@dantegd dantegd added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels May 6, 2021
@dantegd dantegd requested a review from a team as a code owner May 6, 2021 15:24
@github-actions github-actions bot added the Cython / Python Cython or Python issue label May 6, 2021
@dantegd dantegd added the 2 - In Progress Currenty a work in progress label May 6, 2021
@teju85
Copy link
Member

teju85 commented May 6, 2021

Thanks @dantegd for the quick fix!

@dantegd dantegd added 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currenty a work in progress labels May 6, 2021
@dantegd
Copy link
Member Author

dantegd commented May 6, 2021

rerun tests

@cjnolet
Copy link
Member

cjnolet commented May 6, 2021

@gpucibot merge

@codecov-commenter
Copy link

Codecov Report

Merging #3835 (5accbb1) into branch-0.20 (46174b7) will increase coverage by 0.06%.
The diff coverage is 81.72%.

Impacted file tree graph

@@               Coverage Diff               @@
##           branch-0.20    #3835      +/-   ##
===============================================
+ Coverage        85.96%   86.03%   +0.06%     
===============================================
  Files              225      225              
  Lines            16986    17117     +131     
===============================================
+ Hits             14602    14726     +124     
- Misses            2384     2391       +7     
Flag Coverage Δ
dask 49.30% <25.80%> (+0.33%) ⬆️
non-dask 77.93% <80.64%> (+0.12%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
python/cuml/common/memory_utils.py 79.26% <ø> (+0.51%) ⬆️
python/cuml/dask/common/utils.py 43.68% <0.00%> (ø)
python/cuml/ensemble/randomforestclassifier.pyx 83.61% <ø> (ø)
python/cuml/linear_model/logistic_regression.pyx 89.21% <ø> (ø)
python/cuml/neighbors/nearest_neighbors.pyx 93.11% <ø> (-0.03%) ⬇️
python/cuml/tsa/auto_arima.pyx 57.48% <0.00%> (-0.53%) ⬇️
python/cuml/manifold/t_sne.pyx 78.34% <76.31%> (-1.00%) ⬇️
python/cuml/common/input_utils.py 94.33% <100.00%> (+0.08%) ⬆️
python/cuml/dask/common/dask_arr_utils.py 95.83% <100.00%> (+0.05%) ⬆️
python/cuml/fil/fil.pyx 92.55% <100.00%> (-0.31%) ⬇️
... and 46 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 908b2c4...5accbb1. Read the comment docs.

@teju85
Copy link
Member

teju85 commented May 7, 2021

@cjnolet and/or @JohnZed can we get python approval?

@rapids-bot rapids-bot bot merged commit 6ba82ef into rapidsai:branch-0.20 May 7, 2021
vimarsh6739 pushed a commit to vimarsh6739/cuml that referenced this pull request Oct 9, 2023
Closes issue rapidsai#3832 

Related to rapidsai#3767 

cc @teju85 and @venkywonka and @vinaydes who are working on RF

Will be profiling the solution before flipping the PR to ready to review

Quick profiling, on a 2070S laptop,average of 10 runs of a simple LinearRegression.fit (that expects data in `F` format), with a `X` matrix of 500 columns with 100000 rows shows:

- Before the fix:
```
common.input_utils.input_to_cuml_array                     :   0.1795 s
```

- After the fix:
```
common.input_utils.input_to_cuml_array                     :   0.0632 s
```

Authors:
  - Dante Gama Dessavre (https://github.com/dantegd)

Approvers:
  - William Hicks (https://github.com/wphicks)
  - Corey J. Nolet (https://github.com/cjnolet)

URL: rapidsai#3835
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team Cython / Python Cython or Python issue improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants