Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Productize OPG CSR pagerank #816

Closed
afender opened this issue Apr 6, 2020 · 1 comment · Fixed by #947
Closed

[FEA] Productize OPG CSR pagerank #816

afender opened this issue Apr 6, 2020 · 1 comment · Fixed by #947
Assignees
Milestone

Comments

@afender
Copy link
Member

afender commented Apr 6, 2020

Start from the C++ 1D proto that accepts CSR matrices (#812), degrees (#810), and communicator (#814 which should really be passed through #815 ).
This proto is is fairly compatible with the cugraph opg infra as defined in #811.
The code should be cleaned up and tested on real graphs before we can say it is production-ready.

This is the core solver for #485

@afender afender added ? - Needs Triage Need team to review and classify OPG labels Apr 6, 2020
@afender afender changed the title [ENH] Productize OPG CSR pagerank [FEA] Productize OPG CSR pagerank Apr 6, 2020
@BradReesWork BradReesWork removed the ? - Needs Triage Need team to review and classify label Apr 13, 2020
@BradReesWork BradReesWork added this to the 0.15 milestone Apr 13, 2020
@afender
Copy link
Member Author

afender commented Apr 27, 2020

Notice that before one can call its local coo2csr conversion, several things need to happen:

  • A dask-cudf sort of the edge list (or we could use an OPG hash approach). Note that this should happen based on "destinations" primarily for Pagerank because the transposed is needed there.
  • Reorganize dask data accordingly so that each GPU has a chuck of the dask distributed data frame for the edge list of about same size and vertices are not crossing partitions
  • Src and dst are swapped
  • Global src indices are shifted to be 0-based

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants