Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]MG Pagerank #485

Closed
8 tasks
afender opened this issue Sep 11, 2019 · 0 comments
Closed
8 tasks

[FEA]MG Pagerank #485

afender opened this issue Sep 11, 2019 · 0 comments
Assignees
Labels
Epic Tracker for a relatively large body of work that is broken down into stories and issues feature request New feature or request
Milestone

Comments

@afender
Copy link
Member

afender commented Sep 11, 2019

The goal is to start from the current implementation (one process running on multiple GPUs) and transform it to run with one process per GPU.

The current version was designed to take advantage of DGX architectures. The new solution should work on cloud-based environments and non-nvlink systems.

We should bring OPG to cuGraph though generalizing and sharing the comm libs with cuML. That involves moving a generic version of cuML's handle and device allocator to RAFT and cuML's communicator to a separate comm lib. The comm part can't be in RAFT as it is designed to allow the user to swap out the implementation at runtime (so it is not headers only). We will then add these new dependencies in cuGraph and build OPG analytics on top of it.

C++/CUDA
We need to move from shared memory, multithreaded code to multi-process code at the CPP/CUDA level.

  • COO2CSR
  • Degree
  • Pagerank setup
  • Power iteratinon
  • CAPI
  • Tests

Dask/Python
Need to move from the IPC based solution to the recent solution deployed in cuML.

  • python API backend upgrade
  • Tests

Update Doc

Verify Notebooks

@afender afender added feature request New feature or request ? - Needs Triage Need team to review and classify labels Sep 11, 2019
@afender afender changed the title [FEA] OPG Pagerank [FEA]Pagerank Apr 6, 2020
@afender afender added opg Epic Tracker for a relatively large body of work that is broken down into stories and issues labels Apr 6, 2020
@BradReesWork BradReesWork added this to the 0.15 milestone Apr 28, 2020
@BradReesWork BradReesWork mentioned this issue Apr 29, 2020
31 tasks
@BradReesWork BradReesWork removed the ? - Needs Triage Need team to review and classify label Apr 29, 2020
@afender afender mentioned this issue May 26, 2020
@afender afender changed the title [FEA]Pagerank [FEA]MG Pagerank Jul 17, 2020
@BradReesWork BradReesWork modified the milestones: 0.15, 0.16 Aug 20, 2020
@BradReesWork BradReesWork modified the milestones: 0.16, 0.17 Oct 12, 2020
@BradReesWork BradReesWork modified the milestones: 0.17, 0.18 Dec 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Epic Tracker for a relatively large body of work that is broken down into stories and issues feature request New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants