Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setup Ray Cluster for Contraction Hierarchy Runs #4

Open
1 task
wang-yinan opened this issue Aug 30, 2021 · 1 comment
Open
1 task

Setup Ray Cluster for Contraction Hierarchy Runs #4

wang-yinan opened this issue Aug 30, 2021 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@wang-yinan
Copy link
Collaborator

Our example for Contraction Hierarchy has a Graph with 1189 nodes.

The dijkstra_with_contraction will need to be run around times just to form the list of all shortest paths.

  • Setup Ray Cluster on AWS C5 instances (approximately 10 instances of C5.18xlarge).

Each instance provides 72 vCPUs, and we're able to break these CPUs down into half-CPUs using Ray.
This should allow us to setup a multiprocessing pool of around 1,440 concurrent workers, which should be able to process the entire dataset in around 17 minutes.

@wang-yinan wang-yinan added the enhancement New feature or request label Aug 30, 2021
@wang-yinan wang-yinan self-assigned this Aug 30, 2021
@wang-yinan
Copy link
Collaborator Author

The first todo will be to experiment with launching t2.micro instances using ray first. Should be done by the end of next week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant